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J Effects of experimental programs in mathematics on the relevant attitudes and interests 

of ninth grade pupils as measured -by questionnaire indices 



Janes J. Ryan 

I. Introduction 

* 

The development of positive attitudes and interests with regard to the content of any 
subject matter area is usually one of the main instructional objectives emphasized by 
educators and curriculum developers. This is because the pupil’s attitudes 8&d 
interests directly affect* if not represent, the motivational basis for acquisition 
and performance in connection with the subject matter. Consequently, such outcomes 
need to be considered when examining the merits of any instructional program. 



With respect to newer programs in mathematics, it is reasonable to consider and their 
developers a nd proponents have suggested, that in addition to providing a 
effective and functional knowledge of mathematics, these programs might contribute 
more to the development of positive attitudes and interests in mathematics than have 

the traditional programs. 



More positive attitudes and interests toward mathematics might be expected in pari 
because of several characteristics of the newer programs such as: (1) an attempt to 

provide more powerful general concepts and principles which have broader applicability 
and require l^ss emphasis on specific manipulative and computational skills of a 
somewhat monotonous and repetative nature; (2) emphasis on active pupil participa- 
tion in the learning process and "discovery learning”; (3) presenting problems and 
concepts in more meaningful and relevant situations and contexts than has been 
typical of conventional materials. 



This study was carried out as part of a project investigating the effects of several 
recently developed experimental programs in secondary mathematics on the attitudes 
and interests pupils develop toward mathematics. 2 This facet of the project was 
focused on providing an assessment of a broad range of possible attitudinal effects 
which on logical grounds appeared likely to be influenced by the alternate programs 
and/or related conditions of instruction. These effects were examined using indices 
neasuring both the general affective reactions of pupils as well as more specific 
attitude interest components and factors • 



iThe research reported herein wa3 supported in part through a contract (°®*5-10-051, 
Project 5-1028) with the Office of Education, U.S. Department of Health, Education 

and Welfare. 

Very capable assistance with the data gathering, processing and analysis for this 
study was provided by Clifford Carlson, Rodney Rosse, David Klenmack , Chaur C. Chen 
pnd JoAnn Youngren which is gratefully acknowledged. 

2 Effects of modern and con ventional mathematics curricula on pupi l attitudes^ ^ 
interests, apperception of proficiency . Office of Education Project 5-1028, James 
J. Ryan, Project Director. 
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The procedure followed was to administer questionnaires including the various indices 
at the beginning and end of the school year to pairs of ninth grade algebra classes 
taught by the seme teachers, one class with one of the several experimental programs, 
the other with the teacher's conventional program. 

Comparisons were made between pupils in classes receiving the alternate instructional 
programs in terms of their questionnaire responses. Since these effects might vary 
with other conditions of instruction or pupil or teacher characteristics; pupil sex, 
measures of achievement and grades in mathematics, pupil Judgments of relevant 
instructional conditions, and teacher experience with, and evaluation of, the 
experi me nt al programs were considered in the analvsis . Also the analysis considered 
pupil's initial (beginning of year) level of interest and attitudes to determine the 
effects in terms of change over the period of instruction. 

A. Conceptual Considerations 

1. Instructional program effects 

The main purpose of this study was to determine whether the experimental mathematics 
programs individually or collectively contributed to the development of differential 
attitudes toward mathematics in contrast to the conventional programs of instruction. 
Since the concern was with effects or pupil change over the year in which the differ- 
ent instructional materials were used, the pupil's entering or initial attitudes and 
attitude relevant characteristics were considered in the analysis design.. 

Differences observed on an attitude measure between E and C class pupils when the 
initial characteristics of pupils in the alternate instructional groups are equated, 
either statistically or otherwise, could be attributed to differences in the instruc- 
tional conditions or experiences of the separate groups of pupils. Even though the 
instructional materials represented the main difference between the alternate groups 
and the design required that the same teachers instruct both experimental and con- 
ventional classes, other attitude relevant instructional factors or conditions may 
have differed in some consistent or systematic way to contribute to or determine 
attitude differences between experimental and conventional class pupils. Among the 
factors or conditions that might vary with the instructional materials were those 
that could have a direct and those that could have an indirect effect upon pupil 
attitudes. The indirect effects would be those that resulted from changes in other 
instructional factors or conditions that were more directly affected by the instruc- 
tional materials being used. Teachers' attitudes toward the materials, their Grading 
practices, or their demands upon pupil performance if they varied between E and C 
classes could be possible sources of such indirect effects. The direct effects 
would be those resulting from the pupils* interaction with the materials, as such, 
relatively independent of other factors in the instructional situation. The 
assertion of those suggesting that the newer curricula might make a greater contri- 
bution to attitudes toward mathematics appears to imply that such outcomes -'are 
primarily the result of direct rather than indirect effects . Consequently , in the 
analysis consideration was given to and a distinction made between factors that might 
represent direct and indirect effects of the instructional materials. Among the 
former, data concerning pupil judgements or reactions to the materials were gathered 
and among the latter, information concerning teacher's attitudes toward the materials 
and pupil grades were obtained. From a methodological point of view, however, 
because of their interaction over time and because these effects are not independent, 
it nay be difficult to determine the order of effect or causal sequence for such 
concomitant factors with respect to attitudinal outcomes. 
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In addition to the question of the general ' ^f^ssihie^ariations in effects 

programs being examined, there is also the question SttESfc subgroups of 
oroutcomes under different instructional conditions or for Afferent si g v g 

pupils, ms is \^Z 0 LITAZI 0T ^ tT^s tZ “^considered as 
of the various instructional materials. Am ng level of mathematics 

moderator variables vere such pupil charac er * vith the experimental program, 
ability as veil as the amount of 

This set of factors ^^^^^^ituW^ outcccies in that differences for 
conditions affecting or mediating the “****,, _ iod wh i le those characterized 
the latter variables arise during the instructional peri^i 

ca»wa?se^OTC^o?effec?for^he C moderatOT TOriables^is^more^evident^vhile^the 

™ruo^^^ with certain as8mptions - 

2. Attitude and interest measures 

With respect to the several attitude nIMwI ^^^o^ii^ttHte 0 " 16 
general methodological questions vhich should . determ i ne the effects 

objectives of the study, the main objective of ^e study ^termi^ ^ ^ ^ 

of the experimental programs on pupil independent of other logically 
a general affective reaction mtor ^ observed to be 

distinguishable pupil characteristics which „v<i 4 +w nr uroficiency as 

major'^determinants of pupil behavior. Genera ac^ic abili^ or Proficiency^ ^ 
Indicated by achievement tests andgradesandacadenic^chie^ment^o 

sense of a positive attitude toward school and .chool achi^men ^ ^ & 

individual difference factors ^^“he s^hool situation. Since the 

large amount of variation xn pupil behavi . - roncentually distinguished 

variables vith vhich this study was conce ^ed vere 1 ^^^t^^atUtudes 
from both general and specific levels of ability or profici^ 
toward school in general , it is “cessary that the data were 

variables exhibit a certain degree “f^^^f^^^^on of higher inter- 
examined to determine if this were the cas • . titude indices than between 

correlations among the ^ motivation 

s rr jsLsrs ». sjrsisfsss. 

Sct^ C are f ^rtial^ t oS 0 wiSd a a^o^<^de C CTiSSe that the indices vere measuring 
somewhat independent factors. 

A similar question at a different level is also ^ 8 ^ a J" r S g d ^ indices of 
attitude and interest indices ( os contrasted to « ^ the 8 more specific 

interest) vhich vere developed within the P£°^* a „ enera i affective reaction 
component attitudinal dimensions presum sini’ar criteria and observations 

factor reflected in the global attitude 'action, since these 

indicated above ^pplicable to ^is question^ ^ con8truct them to 

indices were developed within the proj * , th interrelations between 

minimize their reflecting common factors by considering the interrex 

items to be included in the separate scales or indices. 

” BEWST.S 

terms of the relations between the measures and vari 
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II . Procedures 



A. Sample 

The sample consisted of 3T pairs of ninth grade algebra ’ .^f J^ect'iweeti- 

taught hjr the same teacher in connection with his partic pa participation in 

gating the achievement effects of the experimental programs. J^eir parti pa 

the latter project consisted of using one of the ^"^"^^^.leZate class 
tbsir algebra classes and their usual conventional r €Jld en d of the 

and of administering designated achievement tests at the beginning end 

school year to both classes. 

The participant classes were in ichools distributed over a five ^ in less 

Iowa, Wisconsin, north Dakota, and South Dakota). The greatest “J°£f r ^ on . 

populated ccocunities rather than the larger oetropo 011 h o i administrators. 

Participation was voluntary on the part of both teachers and school adminis 

Because the achievement evaluation project being carried out wit hJJie study 

materials had been underway for several ^t^r^r^ they were 

had varying amounts of previous experience with the experii^ntaip 
^inT^MfoTecause of the voluntary nature of their 

different number of teachers using each experimental P^ r0 ^ previous ear8 experience 
number of pairs of E and C classes* as well as the J experimental program 

the teachers had with the experimental program, varied among the xp 

conditions • 



Table 1 

Humber of teachers following each E program and the 
mmiber of previous years experience with that progr . 




Aa part of the procedure involved in participation in the 

-Ktrsrss.5- 

in level of mathematics achievement at the beginning of the year. 



3 As discussed below, these classes were not included 
instructional treatment effects. 



the analysis concerned with 
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B. Experimental naterials 

The experimental materials used in the alternate experimental classes were those 
developed under the auspices of the Ball State Indira. College, The Uni- 

versity of Illinois Committee on School Mathematics (UICSM), and the School Math 
matter Study Group (SMSG) . The specific ninth grade textbooks fo~ each of these 
pro-ams were respectively; Algebra I hy Brumfiel, Eicholt and Shanks. Addxson- 
Wesley, Mass. 1961; High 3chool Mathematics Units 1-U, Revised Edition, Illinois 
Committee on School Mathematics, Oniv. of Illinois Press .Urbana, 111., 196Z, 

First Cour se in Algebra. School Mathematics Study Group, Yale Univ. Press, Hew Haven, 
Conn., 1962 . These programs are for the most part prototypes of what has been 
commonly characterized as ’’modern” mathematics* 

C. Data gathering procedures 

Principals and teachers who were already participating in the experimental program 
achievement evaluation project were contacted at the beginning of the school ye 
and requested to cooperate in the data gathering aspects of this project. Upon 
indication of their willingness to do so, principals were requested to make arrange- 
ments for the questionnaires to he administered in the two mathematics classes by 
someone other than the teacher (preferably an administrator or counselor) . Forms 
filled out by those administering the questionnaires indicated that they complied 
with this request in every instance. 

The questionnaires incorporating the various measuring instruments were distributed 
to the schools for administration approximately 5-6 weeks after the begirming of 
the fall term. Most were administered within a week after their receipt. Revised 
questionnaires were again distributed for administration following the same procedure 
within the last two or three weeks of the spring term. 

As part of their participation in the achievement evaluation project, mathematics 
achievement tests were administered to pupils in all classes at the beginning and end 
of tht school year. 

During the following year, schools were contacted to obtain the average grades 
received by pupils in the participating classes during the experimental year and the 

previous year. 



D. Instrumentation 

1. Attitude and interest indices 

Data was obtained on a number of separate indices of attitudes and interests in 
mathematics which were based upon pupils’ expressed feelings, preference. Judgements 
and/or beliefs concerning mathematics as a school subject or as an area of activity. 
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The self-report indices were of two types; those previously L 

present project which appeared to represent measures of a pupil’s more 
global interest in mathematics and those developed within the present P™Jec 
measure more specific component dimensions or factors underlying the attitudes toward 
or the interest in mathematics. The latter were developed to assess certain specific 
logically independent attitude or interest relevant factors or 

that seemed likely to be affected by variations in instructional conditions and which, 
consequently, might contribute differentially to the pupil s overall affective re- 
action or general attitude or interest with respect to mathematics. 



The two previously developed measures of general interest in mathematics were the 
following: 



The Aiken Mathematics Interest Scale (A scale) , a twenty item Likert type 
scale in which the respondent indicates from among five alternatives, 
ranging from "strongly disagree" to "strongly agree", the extent of 
agreement with each of the statements provided concerning mathematics . 

The responses are logically keyed with response weights frcm 1 to 5 in 
the direction of a positive attitude toward mathematics. This scale 
was developed and reported by Aiken ( 1 ) • 



The Dutton Mathematics Attitude Scale (D scale), is a twenty-one 
Thurstone type scale developed and reported by Dutton ( 6 ) • This 
scale is made up of statements representing varying degrees of positive 
and negative feelings, opinions or Judgments about mathematics. The 
statements have weights determined by an a priori scaling procedure 
using Judges familiar with the attitude or interest dimension being 
measured. Respondents were instructed to indicate those statements 
with which they most strongly agreed. Their score was the average 
of the weights of the items they selected. 

Indices to measure the more specific factors or components of mathematics attitudes 
interests were developed in the following way. Questionnaire items were con- 
structed to obtain Judgments, perceptions, feelings or reactions reflecting each of 
a number of attitudinal dimensions or attitude relevant instructional factors. These 
items were included in the questionnaire with the same response format being used for 
each item. 



Following administration of the questionnaire, responses to each item were inter- 
correlated and the resulting correlation matrix factor analyzed using a principle 
components solution rotated to Kaiser’s normal vari-cax criterion. The correlations 
and factor analyses were used to identify items among those constructed for each ° 
the indices that had similar factor loading patterns 4 and that would provide the 
highest intrascale and lowest interscale correlations. This resulted in seme items 
being excluded from the indices for which they were constructed and some intended 
indices being dropped from further consideration because the items were found not to 
be sufficiently independent of those in other indices to warrant consideration as 
a separate dimens ion.** The items included in each of the resulting indices were 



4 It should be pointed out that the orthogonal factors resulting from the factor 
analysis were not used directly to define the attitude dimensions to be measured by 
the items nor was any construct interpretation of these factors attempted. 

5 0ne of these was an iadex of "perceived gain in knowledge" the items for which 
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those exhibiting higher intrascale item correlations and factor pattern s inilar ity 
than those in SterSte indices. Each indices als p gave evidenceof ^Oectipg 
factors sufficiently independent of other indices to be considered a separ 

dimension.. 

The item analysis and Index development activities outlined Above were carried out 
for items inc luded in both the beginning- end end-of-year questionnaires. The 
analys of the Initial set of questionnaire items provided the basis for revision 
ofsceu, . tc. js and development of additional items to obtain more adequate indices 
from the end-of-year questionnaire. 

The following are the indices developed from the questionnaire items to measure more 
specific attitude and intei est factors. 

a. Intrinsic interest - Consisting of items concerned with the degree 
of interest in or preference for activities involving or requiring 
the use of mathematics. 

This scale represented an attempt to get at the aspect of interest that deriws froo 
the pupil-8* reaction to mathematics materials and activities as sue n , . 

an interest that derives primarily from performance, competency, or general acWeve- 
ment motivation factors. That is, the degree of preference for math activities 
independent of outcomes in terms of achievement. Items in this index f^ked about 
pupil’s level of interest, and such things as how much he liked doing homework or 

extra reading in mathematics. 

b. Perceived knowledge - Items concerned with pupils’ Judgement about ^ 
his own knowledge or proficiency in mathematics. This index included 
items requesting the pupils' Judgement of his own proficiency relative 
to other pupils as veil as in absolute terms. 

A pupil’s conception of his own proficiency in a given subject 

been suggested as a factor relevant to subsequent achievement. Recent eviden.. p 
sented by Brookover ( U ) provides direct support for this contention. 

c . Perceived utility - Items concerned with the extent to which knowledge 
of mathematics was seen as facilitating achievement of the pup s 
future goals and objectives, that is "how useful or important they 
felt knowledge of the subject was for what they wanted to do later on. 

This index was included in part because studies of factors underlying soeial attitudes 
have suggested that perceived instrumentality or utility of the attitude o^Jectfor 
achieving valued goals or ends is a relevant factor influencing the intensity of the 
attitude. (See Rosenberg ( 8 ).) In addition, mathematics is often oonceivedofas 
a skill Which is acquired primarily far practical purposes. This is a characteristic 
^ch Wt be less apparent in the "modern" experimental as compared to the conven- 

tional mathematics programs. 



could not be distinguished from those in an index measuring "ease of learning." 
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d. Experienced ease or difficulty learning - Items concerned with the 
ease or difficulty the pupil experienced learning and understanding 
the material presented in the mathematics class. 

Although not obviously an attitude dimension* the pupils* subjective impression of the 
ease or difficulty experienced in conjunction with the required learning tasks is 
reasonably a factor highly relevant to the pupil * s affective reaction to that subject . 

e. Achievement motivation - Items concerned with the pupils* desire or 
determi pfv fcion to achieve at a high level in his mathematics class* 
e.g. **how important is it to you to get a high grade?** 

This Index was included to tap the pupils more general motivation to achieve (in the 
sense suggested by Atkinson ( 2 ) as it might be reflected in his mathematics class . 

In addition to the items comprising the scales providing direct measures of pupil 
attitudes and interests, items were also included to obtain indices of instructional 
factors and conditions which could possibly influence* but less directly reflect, 
attitudinal effects. Some of these items were incorporated into multiple item scales, 
others were used as single items. Among these was a multiple item index concerning 
the amount of homework the pupil engaged in for his mathematics class, i.e., an 
Expended Effort index. 

Single it ems indices concerned with how well the pupil liked the teacher and Judge- 
ments about the ease of understanding and using their texts were also included. The 
textbook item was included to obtain a direct pupil reaction to the experimental 
materials used in the classes. 

2. Response format and attitude index scores 

Each of the items included in the above indices was constructed to obtain a response 
on a graphic scale having appropriate labels accompanying tbe item which in effect 
served to define the dimension of response. Since the same response format was used 
for all items* the items prepared for the separate indices were included in the 
questionnaire as a single set of items following the same response instruction. 

Pupils were instructed to respond to each item for each of the academic subje c t s, ey 
were taking (which were designated as mathematics, English, social studies, science, 
and foreign language). For each item, the pupil's response for each subject was made 
on the same scale that accompanied that item. This form of response permitted each 
item to he scored for a given subject such as mathematics in two ways; (1J in terns 
of actual scale units for that position on the scale (absolute value or a-y) and 
(2) in terns of the rank position (r-p) for that subject relative to the pupils other 

subjects . 

This procedure was followed for several reasons. One was to eliminate certain types 
of response bias that might otherwise occur when responding only with respect to a 
single subject. One type of response bias would be the pupil's general attitu « 
toward school which might be represented by a tendency to consistently respond to ard 
the positive or negative end of the scale on each of the items. This tendency would 
seem to represent what has been characterised by some (see Rorer (7 )) as a response 
set ” Also, scores based on relative rank responses would eliminate response style 
differences between those who tend to respond at the extremes of any scale and those 
who tend to respond more toward the middle of the scale, i.e. response polarization. 
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Another coneiderntion was that . more objective frame of *** 

relatively eoMon or standard for all pupils, would he provided by having pupils 
respond with respect to several subjects In addition to mathematics. 

in short, then for each index two scares could he obtained. One score based upon the 
absolute scale value of the response to each item. The J thC 

relative position for mathematics compared to other subjects for each item. 



3. 



Other measures 



Measures of pupil achievement or proficiency in mathematics were alw obtained. At 
the beginning’and end of the school year, the mathematics section of the ggWft l fl 
Sstsof Educational Progress (STEP), Level Two, ( id was administered to all classes 
in"£^“aMiple. The~pupils average grades in mathematics for 

eighth grade, and the concurrent year, ninth grade, were also obtained for appr xi 
mately 80 percent of the classes in the sample. 

One factor in the instructional situation that could affect the pupils 1 attitudes 
S addition to the naterials used, was the teacher's attitude or Jaiyent co ncernin g 
the naterials. Bren though the teachers had volunteered to partieipate, ** •?“** 
likely that their Judgments and evaluations of the experinental naterials could vary 
over tioe. A nore poStive reaction to the experinental than the conventional program 
night be nore frequently expected, reflecting in pert the WhorneeffectQften 
noted in curricula, evaluation studies, but other factors could cont ribute t o * 
negative evaluation of the experimental program. The nature of the teacher s react! 
could carry over to the pupils, either in a direct way through the teacher s express 
of his attitude or possibly indirectly in terns of overt enthusiasm, etc. 

TO have sooe assessnent of the teacher's attitude and Judgment about the 
material*;, a questionnaire was prepared requesting on a msnber of specific 
teachers judgments, feelings, and their characterisation of the experinental program 
they were teaching. Thirty-five of the ?7 teachers in the sample 
questi onna ires. This questionnaire provided a basis for classifying or tcoria& 
teachers in terms of their relative attitudes end Judgments about the instructional 

which'could be examined for their possible correspondence with the resultant 

pupil attitudes. 

E. Analysis 

The analysis vas carried out to determine vhether the attitudes developed tovard 
mathematics differed between pupils in experimental (E) and conventional (C) classes. 
Pupils in classes instructed with the separ *te experimental programs were compared 
with those in classes instructed by the same teachers with a conventional program. 
Each teacher, therefore, had an E and a C class. Since the main question concerned 
changes or effects occurix* over the school year, it was necessary to take into 
account the pupils* initial level as observed at the beginning of the school year on 
each of the outcome variables being considered. Ibis was done by blocking on levels 
of the premeasure of the dependent variable being analysed and treating the pre- 
measure asaseparate factor in the analysis design which in effect also corrected 
for any initial differences between comparison groups . To make these comparisons a 
four-factor partially hierarchal analysis of variance design was used. The four 

factors were: 
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1. The program used in the E class - the E program comparison condition. 

Each teacher used one of three E programs. Ball State, UICSM and SMSG. 

2. The instructional treatment - whether the class was receiving instruction 
with an E or a C program. 

3. The premeasure control for the dependent variable - two levels determined 
by the median of the overall distribution of scores were used. 

4. The teacher - teachers were nested within the alternate E program 
comparison conditions. 

The instructional treatment and premeasure (or control) factors were cr ? 8 ?!* *“ h 

other and with the teacher and E program factors . A schematic representation of this 
design with the factors and alternate levels designated is given below. 



ERJC 



Representation of analysis of variance design 
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A mixed effects model, with teachers being the single random variable, was used with 
an unweighted means method of analysis • Use of the unweighted means solution was 
required because of the varying proportions of pupils in each class falling in the 
alternate levels or blocks for the premeasure as well as the different numbers of 
pupils in each class. The latter factors also necessitated adjusting the withln-cells 
error estimate for the unequal frequencies within these cells. 



The elements and notation for the four factor partially hierarchal design are shown 
below: 

Sampling 
correction 
factor 



Factor 



A: Program 



Notation and levels 
i * 1, ...I, where 1*3 



B: Treatment j * 1, ...J, where J * 2 

C: Premeasure k * 1, ...K, where K * 2 



Distribution of 
factor levels 

fixed 1*1* 

fixed J*J' 

fixed K=K' 



D: Teacher 



1*1, ...L, where L * Number of 

teachers random L « L' 



m * 1, . . .M, where M * Number of 

pupils/cell 

(unequal in each cell) random M « M* 
Factor D (teacher) is nested under factor A (curriculum) . 



1-4* o 



4 - 



iJl «1 

1 M' X 



The model for this analysis has the form: 

htUm « * ♦ «i * ♦ a6 li * °»ik * BY jk + aBY iJk + 4 l(i) * M jl(i) 

+ Y *kl(i) * BYi Jkl(i) + e m(ijkl) * 

The degrees of freedom, expected mean squares and appropriate error terms for this 
kind of design are given below. 



E 



ERiC 





Source of 
variation 


Degrees of Expected 

freedom mean square 


Appropriate error term 


1) 


A 


I-X + JK»* (a) ♦ JKUtoj* 


^DCA) ° r ^S(ABCD) 


2) 


B 


J-! ^ + KMo b-d(a) + IKUto I 


^b-dU) or ^sCabcd) 


3) 


C 


K-l o' + J,fo C*D(A) + IJUfo C 


^c-dCa) or ^sCabcd) 


h) 


AB 


(I-X) <J-1) °| + KM°b- D (a) + ^AB 


^b-dCa) or ^sCabcd) 


5) 


AC 


(I-X) (I'D °l + ^c-DfA) + JUto AC 


^c-dCa) or ^ s s(abcd) 


6) 


BC 


(J-l) (K-l) ♦ (to| c . D(A) + IUto| c 


^bc-dU) 0 * ^sCabcd) 


7) 


ABC 


(I-X) (J-D (K-D °l * ^BC-DtA) + “‘’ABC 


^bc-dU) 0 * ^sCabcd) 


8) 


3)(A) 


1(H) o| + JK»>2 (a) 


^(ABCD) 


9) 


C-D(A) 


(K-l)X(H) c\ ♦ 3 »g.„ (A) 


^(ABCD) 


10) 


B-D(A) 


(J-l)l(L-l) o| + KHj|. d(a) 


^(ABCD) 


11) 


bc*d(a) 


(J-D(K-l)l(L-l) o\ + Mo| c . d(a) 


^s(abcd) 


12) 


s(abcd) 


H - IJKL al 

• • • « ^ 




Total 




n - 1 

• • • • 





In testing the effects of the nested dimension, D(A), C-D(A), B*D(A) and BC*D(A) , 
prel imi nary tests are required. By using the adjusted within cells error as 
denominator in the F ratio, these tests were run at a * .25. If all these tests 
were null (i.e. «i(i), 6«.e(i), Y« ke U)* and fr^keU) were dropped from the model) 

then the adjusted within cells error was used to test the remaining interactions and 
main effects. If *13 the preliminary tests were significant, then the corresponding 
error term shown in the table was used to test the main effects and remaining inter- 
actions. 
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Because the variance estimates for D(A), gWj^^E^OTOgr^cOTparison 

noolins the respective variances vithin each nested level (i.e. 

from homogenitv of variance the null hypothesis vas re ^® cte ^ ?“ y th er P than across 
the latter hypothesis vas rejected, only cOTp^isonsmadevithi condition, 

the nested condition, i.e., only an analysis for eachalternateEprogram 
using the model given helov, could indicate the actual treatment effects 

Although there vas a different number of teachers in the sarnie required* 1 * 6 

experimental programs, to assess the teachereffects.theanaly Condition, i.e. 

that an equal number of teachers he represented vithin each ^o^as condi^ ^ ^ 

each nested level. This meant that some selection e m ' , - selection vas 

E program conditions having the greater number, toother conditi ^ for 

also necessary due to the rather vide range of class di • , in either the 

of the premeasures vhich resulted in some classes having too fev pupils in either 

high or lov levels or blocks on the premeasure to fit the nd, ^'°^b«s v£hin 

analysis. Both of these conditions vere met by selecting ln 9 cell*frequencies 

each E program condition, those teachers having classes for vhich the cell Wequenc 

vere above the minimum necessary and vhich exhibited the most “ , L made 

vith respect to the alternate levels on the premeas^e. ^is deteminatio^vas^de 

sei>arately for the analysis of each of the dependent variable 9 • 

attitude^andinterest Indices, since for each a different Premeasurevas^ed . 

Scores defining the tvo levels or blocks for the premeasure control variable vere 
established b/the median of the distribution of scores on this variable obtained oy 

pupils in all classes* 

Among the sources of variation in the four factor a toenr , treatment t by I 'pre^ in 

effects and several treatment interactions; progr^ by treatment ^reatme y P 
measure and treatment by teacher vere of primary interest . The treatoent^a 
would represent the degree to vhich there vere E-C differences over all thr 

program comparison conditions, treatment by program n condition- 

Stionlithe E-C differences among the alternate E program treatment) condition 

vhile the treatment by premeasure interaction indicates a variation in the E-C 
difference betveen pupils having higher and lover scores on the premeasure. 

The program and premeasure main effects are of less interest • The 
ef fects^would indicate the extent to vhich there were di^rencesamongthe thxee 
E program comparison conditions considering both classes (E and C) ^r each .e 
A SSe ^sm main effect vould indicate that there vere general differences, 
as reflected in both E and C classes, between the separate sets of teachers vtiig 
each E program and/or that the separate E programs had some differential effect 

both classes vhich necessarily vould have to have been mediated by th teachers 

is a program effect could be attributed to the differences among the sets of teachers 
follovl^^iven E program as much as to the program differences as such. The 
forner^Foss ibilityseens more plausible, hovever, since teacher and program effects 
Sfconfo^ed, it vould not he possible to determine vhich vere the case. In either 
event they are not questions of primary importance for this study. 
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A reliable premeasure main effect would usually be expected since this would indicate 

that the differences existing at the beginning of the i ® I^iveiTmeasure 

sisted through the year. The higher the pre-post correlation for a given measur 

the greater should be the premeasure effect. 

The main effects and teacher by treatment interactions were also of somewhat 

less^oncern^ince they reflect general teacher differences (within Epr^ram 
c ondi tions) common to bote E and C classes and do not, therefore, have any cl 
implication for the treatment effects. 

The treatment by teacher interactions were, however, given seme consideration in that 
they would indicate differential treatment effects among teachers. 

Th* foisr-factor analysis was car: 1 ed out across all E program comparison conditions 
tod^TeThemtoeo, the funeral instructional treatment effectsc^nontoall 
E programs, and to determine if there were reliable variations in the M dif^ences 
beft^Ugrams. It was of equal interest to examine the instructional treatment 

effects for each of the separate E programs. 

For each of the E program comparison conditions, a three-factor analyst i was also 

carried emt following essentially the same analysis design as used * 

£££.“ For the «Le-factor analysis within the E 

the three factors were crossed and a 2 x 2 x t factorial de gn 

senting the number of teachers was used. Here again teachers were treated as a 

random variable. 



The model for the within program three-factor design was: 

X Jklm(i) * “i + 6 J +Y X + *1 + * 8 V * Y< kl + 6Y6 Jkl + E m(3kl)(i) 

The degrees of freedem, expected mean squares, and appropriate error terms are shown 
below: 



Source of 
variation 

B 

C 

BC 

0 

BD 

CD 

BCD 

S(BCD) 

TOTAL 



Degrees of 
freedom 

J-l 

K-l 

(J-1)(K-1) 

L-l 

(J-1)(L-1) 

(k-D(l-i) 

(J-1)(K-1)(L-1) 

N - JKL 
• • • 

N - 1 



Expected 
mean square 

0| + KMogp ♦ KMj2 
o\ * JM 

®e + ^BCD + ““BC 
O 2 + JKMd 2 

o| + KMo| d 

°l * 



e 

j 2 

e 



^BCD 



Appropriate 
error term 

^BD ° r ^S(BCD) 

^CD ° r MS S(BCD) 

^BCD OT ^SCBCD) 



MS 



's(bcd) 



MS 



S(BCD) 



MS 



S(BCD) 

^s(bcd) 



o 
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The criterion for the preliminary test on the interaction effects BD, CD, BCD was 
o * .25. If the call hypothesis vas rejected, then MS^ was used as the error term 

for testing the B effect, MS^p for C effect, for BC effect. 

The vithin F program condition analysis was carried out routinely independent of the 
results of the tests for the overall analysis. If, for the vithin program analysis, 
significant treatment main effects or treatment interactions were observed in the 
absence of an indication of such effects from the overall analyses, then any Inter- 
pretation or generalization of the vithin program effect would have to be qualified 
since the probability of a Type I error would be increased by this practice by 
virtue of the dependent hypotheses. 

For some variables the analysis vas carried out for males and females separately as 
veil as for the sexes combined. 

Initial achievement scores obtained for the classes as veil as questionnaire infor- 
mation from the participant teachers provided an indication that five homogeneously 
grouped classes (some high, some low ability) among those that would otherwise be 
incited in the data analysis sample. Since such grouping could in itself be a 
source of certain differential attitudes and reactions between a pair of classes, 
both classes (E and C) for teachers having a homogeneously grouped class were, 
therefore, eliminated from the analysis directly concerned with the instructional 
effects. Four of these teachers were using the SMSG program and one the Ball State 

program. 

III. Results 

A. Overall E-C differences 

1. General meas ures cf interest in mathematics 

a. Ali en Scale 

Table 2 shou’s the adjusted (unweighted) means obtained for E and C class pupils in 
each program comparison condition on the Aiken Interest scale administered at the 
end of the year. Table 3 shows the results of the analysis of variance of the 
scores obtained on this measure across all program comparison conditions for the 
sexes separately and combined. 



Over all programs the C class pupils had a higher mean Aiken scale score than the E 
class pupils which was reflected by a significant treatment main effect in the 
analyses. This result was obtained even though in the UICSM comparison the E class 
mean was higher than that for the C classes. However, the homogeneity of variance 
assumption for the teacher by treatment interaction term required for the treatment 
effects test was not tenable, i.e. there was a highly significant difference among 
the separate variances that were pooled to estimate this interaction effect. 
Consequently, only the analysis within each of the separate program comparison 
conditions could provide an indication of the instructional treatment effects. For 
these comparisons , the three-factor analysis of variance design was used, the results 
of which are shown in Table U. 
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TABLE 2 



♦ 

Aiken Mathematics Interest Scale adjusted mean scores for pupils in E and 
All pupils 9 pairs E and C classes in each E program condition. 





Treatment 


- 


I 






C 


Experimental 

Program 


Premeasure 

Level 


low 


high 


ave. 


low 


high 


Ball State 


• 


2,87 


3.69 


3.26 


3.03 


3.90 


UICSM 




2.98 


3.71 


3.3k 


2.77 


3.90 


SMSG 




2.72 


3.73 


3.23 


2.91 


3.72 


Total 




2.8$ 


3.71 


3.28 


2.90 


3.8k 



Males 5 pairs E and C classes 



Ball State 


3.04 


UICSM 


2.96 


SMSG 


3.06 


Total 


3.02 


Females 


7 pairs E and C classes 


Ball State 


2.86 


UICSM 


2.93 


SMSG 


2.73 



2.84 



3.69 


3.37 


2.99 


3.77 


3.98 


3.k6 


3.17 


3.79 


3.72 


3.39 


2.85 


3.93 


3.79 


3.k0 


3.00 


3.83 



3.29 


3.06 


2.84 


3.78 


3.79 


3.36 


2.56 


k.U 


3.61 


3.17 


2.78 


3.80 


3.56 




2.72 


3.89 




classes • 
ave. 

3.46 

3.33 

3.32 

3.37 

3.38 
3.48 

3.39 
3.41 

3.31 

3.33 

3.29 



Total 



3.20 



3.31 
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TABLE 3 

F-ratios from the analysis of variance over all E program comparison conditions for 
the Aiken and Dutton scale scores for males and females separately and combine a. 






Source of Variance 


d.f. 


All 

Pupils 


Aiken 

M 


F 


All 


Dutton 

M 


F 


Program 


2 


1.1 


.4 


.6 


.1 


.7 


.9 


Treatment 


1 


U.3* 


0.0 


1.4 


1.0 


0.0 


1.1 


Premeasure 


1 


U13.M*** 


88.3*** 172.9*** 


179.6*** 


85.1*** 201.7** 


Program X Treatment 


2 


1.4 


0.0 


.T 


.8 


.1 


.9 


Program X Premeasure 


2 


.4 


.3 


U.3* 


3.3* 


0.0 


.1 


Treatment X Premeasure 


1 


.4 


•2 


9.7* 


1.5 


.1 


4.4 


Program X Treatment 


2 


1.9 


2.5 


1.3 | 


i - 2 


0.0 


3.3 


X Premeasure 
Teacher 


3(t - 1) 


1.6* 


1.5 


2.7** 


.6 


2.0* 


1.7* 


Humber of teachers 


t ■ 


9 


5 


7 


8 


7 


7 


Teacher X Premeasure 


3(t - 1) 


.9 


1.3 


.7 


.7 


1.3 


* t 


Teacher X Treatment 


3(t - 1) 


.8 


6 


1.6 


.4 


.9 


1.6* 


Teacher X Treatment 


3(t - 1) 


1.8* 


.9 


.8 


.8 


1.4 


1.5 


X Premeasure 

















* p <.05 

** p <.01 
*## p <.001 
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TABLE u 



P- ratios fro* the analysis of variance for the Aiken and Dutton scale scores within 
each of the experinental progrcr. comparison conditions. 



Experimental 
Program 



Bsll State 



UICSM 



SMSG 



o 

ERIC 



cjoiit 1 ^ g £ VcrifiDCC 


All 

d.f# Pupils 


Aiken 

M 


l 

f 1 


Dutton 

All 

Pupils M 


F 


Treatment 


1 3.0 


0.0 


1.5 ‘ 


.3 


0.0 


1.0 


Premeasure 


1 88 .U*** 


27 . 5 *** 25 . 7 *** j 105 . 4*** 


31.7*** 


51.5*** 


Treat X Premeasure 


1 0.0 


.2 


3.7 i 

1 


.5 


.1 


.1 


Teacher 


(t - 1)*1.5 


1.4 


“ ! 


1.9 


2 . 8 * 


1.1 


Treat X Teacher 


(t - 1 ) 1.8 


.7 


2.0 ) 


.5 


1.4 


1.4 


Premeas. X Teacher (t - l) 1.3 


1.2 


.7 


.3 


.5 


.6 


Treat X Premeasure 


(t - 1 ) 2 . 6 ** 


.9 


1.2 


1.9 


1.8 


1.8 


X Teacher 














Treatment 


1 0.0 


0.0 


- 1 i 


.1 


.1 


.2 


Premeasure 


1 147 . 1 *** 


40.0*** 90.5*** 


40.4*** 


25.7** 


75. 


Treat X Premeasure 


1 5.7* 


2.1 


7.6** 


3.2 


.1 


16 . G** 


Teacher 


(t - 1) 1.6 


2.3 


2.0 


1.2 


2.0 


2.3* 


Treat X Teacher 


(t - 1) .2 


.9 


.4 

1 

f 


.2 

1 

1 


.7 


2.1 


Premeas. X Teacher (t - 1) .8 


.9 


.2 


1 2.5* 


1.4 


.8 


Treat X Premeasure (t - l) .9 


1.3 


.5 


1 ia 


.7 


1.0 


X Teacher 














Treatment 


1 1.6 


0.0 


.5 


; 1.3 

i 


.1 


3.0 


Premeasure 


1 15T •<>*** 26.9** 


71.6** 1 


* 51.2*** 


19.6** 


79 . 4 ** 


Treat X Premeasure 1 1»® 


3*0 


.3 


0.0 


0.0 


0.0 


Teacher 


(t - 1) 1.8 


.8 


3.6** 


.3 


.9 


1.9 


Treat X Teacher 


(t-1) .5 


.3 


2.4* 


.4 


.6 


1.2 


Premeas. X Teacher (t - 1) .4 


1.9 


1.3 


.4 


2.2* 


V 

* 1 


Treat X Premeasure (t - l) 1.8 


.4 


.7 


I * 5 


1.5 


1.6 



X Teacher 

®t = number o f teachers (i.e. 
pairs of classes indicated in 
the table of means for each 
measure. 



p <.05* ** P <# 0i# 



*## 



<.001 
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The results of the analysis over all programs for males and females separately did 
not indicate a reliable treatment effect , but for the females there was a significan 
treatment by premeasure interaction. The latter effect resulted from the fact tha 
among girls having initially lower interest scores, the end of year scores tended to 
be relatively higher for the E than the C class pupils while among girls having 
higher initial interests, those in the C classes had higher scores at the end of the 

year. 

The results of the separate analysis for each program comparison condition for each 
sex separately are also shown in Table 4. 

The analyses within each program comparison condition for all pupils indicated no 
significant instructional treatment main effects. The reliable treatment difference 
noted above when the analyses was made over all programs was apparently a spurious 
result of the untenable homogeneity of variance assumption. For the UICSM comparison 
a significant treatment by premeasure interaction was obtained. The analyses within 
the UICSM program comparison for males and females separately indicated that this 
effect (which was also observed to be significant in the analyses for females across 
all E treatment conditions) was highly significant for girls but non-significant for 
boys. A test of the E-C differences for UICSM girls within each of the initial 
interest levels showed that in the low interest level the E class mean was reliably 
higher (F = 4.4, p < .05) than that for the C classes, but that for those having 
initially higher interests, the difference in favor of the C class girls did not 
quite reach the .05 level of reliability (F = 3»2, .05 < P < »10). 

b. Dutton scale 

Table 5 shows the adjusted (unweighted) Dutton Attitude scale means obtained for E 
and C class pupils in each E program comparison condition. The analysis of variance 
across all program comparison conditions for both sexes separately and combined 
ind icated no significant treatment differences (either main effects or interactions) 
for this measure. These results are shown in Table 3. 

For the analysis within each E program condition for the Dutton scale (shown in 
Table 4) , the only reliable treatment effect observed was a treatment by premeasure 
interaction for girls in the UICSM comparison. As was observed on the Aiken scale, 
among girls having lower interest scores at the beginning of the year, those 
instructed with the UICSM program had higher post instruction scores than those in 
the C classes while the difference was in the opposite direction for those having 
higher pre instruction interest scores. A test of the differences between each 
E-C mean within the premeasure levels indicated that for the lower level the E mean 
was reliably greater than the C class mean (F = 11.1, p < .01) while for the higher 
level, the C class mean was reliably greater (F » 6.1, p < .05). 

The scales providing a more general or global measure of mathematics interest did not 
reveal any consistent overall differences between pupils instructed with any of the 
experimental programs and those instructed with conventional programs. On the Aiken 
scale there was a general tendency for the E-C differences to be greater in favor 
of the C classes among girls having higher rather than lower initial interests. 

This variation in the E-C difference was most pronounced and statistically reliable 
for girls instructed with the UICSM program. For the latter comparison on both the 
Aiken and Dutton scales, among girls having initially lower interests, those in UICSM 
classes had the higher mean interest scores while for girls with higher initial 
interests those in the comparison conventional classes had the higher means . 



J 




TABI2 5 



% 

* 

Dutton Mathenatlca Attitude Scale adjusted mean scores for pupils in E and C classes. 
avj pupils 8 pairs E and C classes in each S program condition. 



Experimented 

Program 


Treatment 

Premeasure 

Level 


low 


E 

high 


ave. 


low 


C 

high 


ave. 


r ivft* ow _ 

Bell State 




5.10 


6.60 


5.85 


5.02 


6.85 


5.94 


UICSM 




5.19 


6.56 


5.88 


4.85 


6.81 


5.83 


SMSG 




4.5U 


6.92 


5.73 


4.87 


7.38 


6.13 


Total 




«a.95 


6.70 


5.82 


4.91 


7.02 


5.97 


Males 


7 pairs E and C classes 












Ball State 




5.4l 


6,97 


6.19 


5.55 


6.96 


6.26 


UICSM 




5.25 


6,72 


5.99 


5.23 


6.56 


5.90 


SMSG 




5.33 


6.79 


6.06 


5.36 


6.87 


6.11 


Total 




5.33 


6.82 


6.08 


5.38 


6.80 


6.09 


Females 7 pairs E and C 


classes 












Ball State 




4.58 


6.32 


5.45 


U.80 


6.70 


5.75 


UICSM 




5.22 


6.22 


5.72 


b.18 


7.00 


5.59 


SMSG 




4.34 


6.09 


5.21 


lt.67 


6.44 


5.56 


Total 




4.71 


6.21 


5. *6 


4.55 


6.71 


5.63 



3 
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2. Indices of specific attitude dimensions 



. . werG derived from the items comprising the indices 

As discussed above, two scores were aeriveu xrw u factors. One score 

developed to assess specific attitude and interest dmenslo ^orja c^ ^ 

was based upon the absolute scale value response response to each item 

designated the a-v score. The second score -as ^ ^T^i« for 

for mathematics relative to other subjects, i.e. the subject rank pos 

mathematics vhich -#as designated the r-p score. 



&• 



Absolute-value Scores 



i. Intrinsic Interest 

The Intrinsic Interest index a-v score means are shown in Table 6. Th® 

results of the analysis across all of the E ^treatment int^r- 

in the analysis for f e-ales alone, there £sa ^/^^^nean and the 
action. This effect -as a result of the OT^ girls having a conyenti<jnal 

Ball State girls having a lower mean than those in th each ezpe rimental 

comparison classes. The results of the cmalys- gi of the E-C differences 

program comparison condition shown in Table 8, of significance, 

within the separate treatment conditions reached the .05 le 6“ 

The significant interaction and the pattern * ^itive 

girls the intrinsic interest of those in the UICSM exertional classes 

relative to the intrinsic interest of girls in the c. Mpar compared to 

than -ere the interests of girls instructeaviththeBall ^ ^ 

those in their coamarison classes. Ho reixohle treatment erreccs -ere 
tte La^yses Lrior this measure for males or for all pupils combined. 

ii. Perceived Utility 

_ „ a.-rr=r -- stjst -- jarssastf ss. 

are shown in Tabic T • 

Ing all pupils and considering ema es having a hi ghe r mean Perceived Utility 

appeared to be the result of the C higher mean in 

score in the Ball State comparison and tne E class ^iis n ue of the sexes 

the UICSM comparison. The ^tMn program ^ results of the latter analyses 

separately and combined, and M shown in Table 0.^ me re 

located that -hen all pupils -ere considered, to « n-C di ffere. for 

BaU State ,V IC f „ C °Xthr ^aSfer^Le ^s reliable. The latter analyses 

also indicated a significant treatment ^ fayor of the m C SM classes being 

comparison vhich was the result of E . . initial Perceived Utility scores. 

EVXfS 'SSSSZZ for any of the 

programs. 
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TABLE 6 

% 

totrin glc interest adjusted mean index scores for pupils in E and C classes 
All pupils 9 pairs E and C classes in each E program condition. 

Treatment £ — 



Experimental 


Premeasure 


lov 


high 


ave. 


lov 


high 


ave. 


Program 


Level 






Pfti 1 State 




2.1(7 


3.1(1* 


2.96 


2.48 


3.38 


2.93 


UICSM 




2.55 


3.27 


2.91 


2.44 


3.3*( 


2.89 


SMSG 




2.1(6 


3.1(3 


2.9k 


2.47 


3.51 


2.99 


Total 




2.U9 


3.38 


2.9k 


2.46 


3.U1 


2.94 


Males 


f pairs E and C 


classes 












Ball State 




2.23 


3.50 


2.86 


2.40 


3.U5 


2.92 


UICSM 




2.57 


3.36 


2.97 


2.43 


3.26 


2.86 


SMSG 




2.5 1 * 


3.50 


3.02 


2.34 


3.7U 


3.04 


Total 




2.1»5 


3.1(5 


2.95 


2.39 


3.1(8 


2.94 



Females 


6 pairs E and C classes 












Ball State 


2.49 


2.94 


2.71 


2.76 


3.35 


3.05 


UICSM 


3.05 


3.37 


3.21 


2.47 


2.95 


2.71 


SMSG 


2.46 


3.10 


2.78 


2.37 


3.11 


2.74 


Total 


2.67 


3.13 


2.90 


2.53 


3.13 


2.83 



I O 

Lerlc 

Lm. 






Jit 






1 



TABUS 8 



F-ratios obtained from the analysis of variance within each of the E program comparison 
conditions for the Intrinsic Interest and Perceived Utility index s-v scores. 

Perceived Utility 

* 

* All 



Experimental 

Program 



Intrinsic Interest 
All 



Ball State 



UICSM 



SMSG 



Source of Variance d.f. Pupils 


M 


F 


Pupils 


M 


F 


Treatment 1 • 1 


.1 


2.7 


2.2* 


0.0 


1.3 


Premeasure 1 67.2** 


2*0. 6*** 


6.6* | 


49.1*** 


29.1*** 12.5** # 


Treat X Premeasure 1 .1 


.4 


•1 i 


.4 


0.0 


.1 


Teacher (t - l) a 3.1*** 


2.4* 


4.4** ; 

i 


i 1.2 


.6 


1.0 


Treat X Teacher (t - l) .8 


1.0 


.6 : 

i 


! 1-9 


1.0 


.9 


Premeas. X Teacher (t - 1) .7 


1.1 


.9 


; *- 2 


.1 


.8 


Treat X Premeasure (t - l) .3 


.5 


1.0 


1.9 


1.5 


1.3 


X Teacher 












Treatment 1 0.0 


.5 


4.0 


4.4* 


2.6 


6.2* 


Premeasure 1 57.5*** 


11.9* 


1.8 


i 19.9*** 


3.2 


14.3*"* 


Treat X Premeasure 1 .5 


0.0 


.1 


1 1.0 

i 


.1 


4.0* 


Teacher (t - l) 1.8 


2.5* 


1.3 


5.2»* 


2.4 


5.0*** 


Treat X Teacher (t - l) 1.0 


.7 


2.2 


i 


.3 


.7 


Premeas. X Teacher (t - l) 1.2 


1.8 


3.2* 


¥ 

i 1.6 

i 


1.8 


.4 


Treat X Premeasure (t - l) 1.4 


1.8 


2.1 


1.5 


1.4 


1.0 


X Teacher 












Treatment 1 .2 


0.0 


0.0 


3.5 

1 


0.0 


0.0 


Premeasure 1 62 • 3*** 


52.7*** 16.0*** 


« 18.4*** 

! 

1 


2.3 


16.9*** 


Treat X Premeasure 1 .2 


.7 


.1 


' 1.9 
• 


1.4 


.6 


Teacher (t - 1) 1.8 


.7 


1.4 


j 3.8*** 

I 


1.1 


3.4*** 


Treat X Teacher (t - l) 1.0 


.3 


1.6 


! ,6 


.1 


1.1 


Premeas. X Teacher (t - l) 1.6 


1.2 


.7 


1.5 


1.8 


1.3 


Treat X Premeasure (t - l) 1.2 


2.9* 


.6 


: 1.1 


1.1 


2.0 



X Teacher 

*t * number of teachers (i.e. 

pairs of classes) indicated in 
the table of m^ans for each 



* p <.05, ** p <.01, *** p <.001 



measure . 



■ ■' . ■Ti nu i jum min u 
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TABLE 9 

Perceived Utility adjusted mean index scores for pupils in E end C classes. 
All pupils 8 pairs E end C classes in each E program condition. 
Treatment E £ 



Experimental Premeasure 


high 


ave. 


low 


high 


ave. 


Ball State ^21 


5.21 


4.71 


4.58 


5.49 


5.04 


UICSM ^.66 


5.31 


4.98 


4.26 


5.06 


4.66 


SMSG ^*13 


5.06 


4.60 


4.50 


5.17 


4.83 


Total U.33 


5. 19 


4.76 


4.45 


5.24 


4.84 


Males 5 pairs E and C classes 


Ball State 4.29 


5.58 


4.94 


4.27 


5.64 


4.95 


UICSM **«97 


5.55 


5.26 


4.73 


5.13 


4.93 


SMSG 5.00 


5.17 


5.08 


4.72 


5.38 


5.05 


Total **«75 


5.43 


5.09 


4.57 


5.38 


4.96 



Females 6 pairs E and C classes 



Ball State 


3.78 


4.72 


4.25 


4.12 


4.94 


4,53 


UICSM 


4.37 


4.81 


4.59 


3.23 


4.69 


3.96 


SMSG 


3.75 


4,51 


4.13 


3.60 


4.71 


4.15 


Total 


3.96 


4.63 


4.32 


3.65 


4.73 


4.21 
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In general these results indicate that pupils instructed with the Ball State materials 
had a tendency to perceive mathematics as having less utility than did pupils m 
conventional classes taught by the same teachers while pupils instruct el with the 
UICSM materials perceived mathematics as having greater utility than did the pupils 
in the comparison conventional classes. This effect appeared to be stronger for 
girls than boys. Also for girls, the E-C difference for the UICSM program was more 
reliable than the E-C difference for the Ball State ccmparison. 

It appears then, that instruction with the Ball State program resulted in a perception 
of mathematics as having less utility for future goals or objectives while instruction 
with the UICSM program resulted in a perception of greater utility. 

iii. Perceived Knowledge 

The adjusted mean Perceived Knowledge index scores for the E and C class 
pupils are shown in Table 10. No significant treatment main effects or treatment 
interaction effects were indicated by the analysis of variance when all program 
comparison conditions were considered. The results of this analysis are shown in 

Table 7* 

For the analy sis on this measure within each E program condition, shown in Table 11, a 
reliable treatment difference was indicated for the SMSG ccmparison when all pupils 
and males alone were considered. This effect was a result of the SMSG pupils 
obtaining lower perceived knowledge scores at the end of the year than conventional 
class pupils. The effect for all pupils combined appears to be due primarily to 
differences in this regard for boys rather than girls. 

In general the experimental programs do not appear to have any extensive effects on 
pupils* Judgments of their knowledge of mathematics as measured by this index. There 
was a tendency for boys instructed with the SMSG program to Judge their knowledge 
somewhat lower than did boys in the conventional comparison classes . 

iv. Ease of Learning 

Table 12 shows the adjusted mean scores obtained by E and C class pupils on 
the Ease of Learning (EOL) index » In each program comparison condition, the means 
for pupils in theC classes were in every instance higher than those for pupils in the 
respective E classes .That is, the C class pupils reported greater ease of learning 
(i.e., less difficulty learning) the subject matter in their mathematics class than 
E class pupils. The results of the overall analysis of variance, shown in Table 7 , 
indicate that the E-C difference over all program comparison conditions is quite 
reliable both when all pupils and when "iris alone are considered. The analysis for 
boys alone did not indicate any significant instructional treatment differences 
suggesting that the effect observed with the sexes combined is due more to the 
differences in this regard for girls than for boys. 

The results of an analysis within each of the programs for both se::es separately and 
combined are shown in Table 11. Considering all pupils the E-C difference was 
reliable at the .05 level only for the UICSM program comparisons while for girls a 
highly reliable difference was observed for the Ball State program comparison. No 
treatment differences were observed for boys for any of the comparisons. 
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TABLE 10 

Perceived Knowledge adjusted mean index scores for pupils in E and C classes. 
All pupils 8 pairs E and C classes in each E program condition. 





Treatment 


E 






C 




Experimental 

Program 


Premeasure 

Level low 


high 


ave. 


low 


Mgfi 


ave. 


Ball State 


8.09 


10.47 


9.28 


8.72 


10.1*6 


9.59 


UICSM 


8.60 


10.07 


9.33 


8.26 


10.1*2 


9. 3l* 


SMSG 


7.56 


10.12 


8.84 


8.10 


10.1*2 


9.26 


Total 


8.08 


10.22 


9.15 


8.36 


10.1*3 


9.39 


Males 


6 pairs 8 and C classes 












Ball State 


8.U9 


10.00 


9.25 


7.98 


10.37 


9.18 


UICSM 


8.U7 


10.29 


9.38 


8.55 


10.52 


9.53 


SMSG 


7.90 


10.69 


9.30 


8.95 


11.17 


10.06 


Total 


8.29 


10.33 


9.31 


8.1»9 


10.69 


9.59 



Females 6 pairs E and C classes 



Ball State 


8.05 


10.50 


9.28 


8.80 


10.50 


9.65 


UICSM 


8.80 


10.62 


9.71 


7.86 


10.1*8 


9.17 


SMSG 


7.7U 


9.89 


8.81 


7.90 


10.02 


3.96 


Total 


8.19 


10. 34 


9.26 


8.18 


10c 33 


9.26 



o 

ERIC 
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TABLE 11 



F-ratios obtained fro. the analysis of vori-noe vithin eaeh of the E progra. comparison 
conditions for Perceived Knowledge and Ease of Learning * 

Perceived Knowledge ( Ease of Learning 

Experimental 
Program 



UICSM 



SMSG 




Source of Variance 


All 

d.f . Pupils 


M 


\ 

F ! 


All 

Pupils 


M 


F 


Treatment 


1 1.0 


0.0 


1.1 i 

i 




3.1 


.9 


20, 4* ^ 


Premeasure 


1 81.0*** 


23.3*** 35.0*** 


| 56.7*** 


22.9*** 14.0* 


Treat X Premeasure 


1 .9 


.5 


1.1 




1.2 


2.5 


0.0 


Teacher 


(t - l) a 2.2* 


1.0 


1.1 


1 

i 

♦ 

i 


1.4 


ia 


1.2 


Treat X Teacher 


(t - 1) l.T 


2.4* 


.6 


1 


.9 


1.1 


.8 


Premeas. X Teacher (t - l) .9 


.4 


.5 


i 

i 

t 

t 

i 


1.2 


1.1 


1.7 


Treat X Premeasure 


(t - 1) 2.2* 


2.5* 


.9 


1.0 


.4 


1.3 


X Teacher 
















Treatment 


1 0.0 


.1 


1.9 


i 

* 

* 

1 


4 . 9 * 


.4 


2.2 


Premeasure 


1 48.9*** 


16.5*** 


32.5*** ! 

f 

» 


86 . 0 *** 


23.0*** 71.9**'* 


Treat X Premeasure 


1 1.7 


0.0 


1.1 


1 

i 

\ 

1 


.2 


0.0 


.6 


Teacher 


(t - 1) .9 


.6 


1.8 


\ 

f 


1.3 


.5 


1.5 


Treat X Teacher 


(t - 1) .7 


.7 


.8 


4 

j 


.5 


1.9 


.9 


Premeas. X Teacher (t - l) .4 


.9 


.3 


1 


1.0 


.3 


.4 


Treat X Premeasure (t - l) .7 


1.2 


1.2 


t 


.4 


.4 


.2 


X Teacher 
















Treatment 


1 3.9* 


4.0* 


.6 


i 

] 


1.4 


.1 


1.6 


Premeasure 


1 70 . 6 *** 


17.9** 


48.1*** 


65 . 2 *** 


13.7* 


21.5* :J | 


Treat X Premeasure 1 *3 


.6 


0.0 




.5 


0.0 


.5 i 

- 


Teacher 


(t - 1) 5.1** 


2.3* 


5.0** 


4 . 8 *** 


.5 


5.r* {i 


Treat X Teacher 


(t - 1) .5 


.3 


1.6 




! 1.7 

i 


.4 


3.1 


Premeas. X Teacher (t - l) 1-9 


2.4* 


1.0 




i 1.8 


2.0 


1.9 ; 


Treat X Premeasure (t - l) !•! 


.9 


1.2 




; i.u 

1 


.5 


1.8 


X Teacher 
















a t « nurf er of teachers (i,e. 




<.05, ** 


f <.0'i, 


*** p 


<.001 



the tab'J e of r-san- for earh 
r assure. 
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TABLE 12 



Base of Learning adjusted mean index scores for pupils in E and C classes. 

All pupils 8 pairs E and C classes in each E program condition. 

B C 

Treatment 2, — 



Experimental 


Premea8ure 

Level low 


high 


ave. 


low 


Wfih 


ave. 


program 
Ball State 


2.57 


3.66 


3.12 


2.93 


3.74 


3.34 


UICSM 


2.55 


3.74 


3.14 


2.79 


4.10 


3.44 


SMSG 


2.49 


3.60 


3.04 


2.57 


3.86 


3.21 


Total 


2.54 


3.66 


3.10 


2.76 


3.90 


3.33 


Males 


6 pairs E and C classes 












Ball State 


2.26 


3.60 


2.93 


2.79 


3.47 


3.13 


UICSM 


2.70 


3.84 


3.27 


2.94 


3.99 


3.46 


SMSG 


2.74 


3.82 


3.28 


2.79 


3.87 


3.33 


Total 


2.57 


3.76 


3.16 


2.84 


3.77 


3.30 


Females 5 pairs E and 0 classes 












Ball State 


2.63 


3.60 


3.12 


3.53 


4.52 


4.03 


UICSM 


2.32 


3.92 


3.12 


2.47 


4.39 


3.43 


SMSG 


2.68 


3.75 


3.21 


2.93 


4.35 


3.64 


Total 


2.54 


3.76 


3.15 


2.98 


4.42 


3.70 



t 

a 



O 

ERIC 



tftti 
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In general, although the effect was not very large there was a consistent ^ndency 
for pupils instructed with each of the experimental programs to report more difficulty 
learning mathematics than pupils in the comparison conventional classes . 
tendency was more evident for girls than boys and most pronounced for girls instructed 

with the Ball State program. 



b. Rank Position scores 

Indices measuring specific attitude and interest dimensions were derived from item 
responses in terms of the rank position for mathematics relative to other subjects. 
Since pupils differed as to both number and actual academic subjects other than 
mathematics in which they were enrolled, the mathematics ranks were determined 
respect to the combination of academic subjects which would permit inclusion of the 
largest number of pupils for comparison. Within the sample, among the possibxe 3, 

U, and 5 subject combinations of mathematics, English, science, social studies and 
foreign language, the largest number of pupils were enrolled in a 3 subject ccmbina- 
ticr of mathematics, English and science. 

Scares in terms of the rank position cf mathematics relative to English and science 
were derived by summing the rank of the response fo~ -«th (1, 2 or 3) to each item 
in a given index. Individual scores for each index were then converted to standard 
scores having a mean of 50 and a standard deviation of 10. 



The determination of mathematics rank position relative to two other specified 
subjects did reduce somewhat the number of pupils that could be included in the 
analysis, i.e., only those taking English and science in addition to mathematics. 
Although the overall proportion reduced was relatively small for the r-p scores, 
this additional restriction did preclude carrying out a separate analyses for eac 
sex when teachers were treated as a separate dimension because of the increased 
difficulty of obtaining sufficient frequencies in the separate cells required for 
the analysis. For these score* the stx differences will be examined in connec 

tion with other analyses of the data. 



For the r-p scores in addition to the analysis of variance across all E program 
comparison conditions, an analysis within each E treatment condition was also carried 

out. 

Table 13 shows the ;mweighted (^ijusted) means obtained by E and C class pupils in 
the separate instructional treatment conditions on each of the indices for which 
rank position scores were determined. The results of the comparisons among these 
means considering all of the E programs for each indices are shown in terms of the 
F-ratios obtained from each analysis of variance in Table 14. 



i. Intrinsic Interest 

Wo significant treatment main effects nor program by treatment interactions 
were observed for the index measuring Intrinsic Interest using r-p scores in the 
analysis across all E program conditions as shown in Table 12. ftie higher mean for 
the C class pupils in the Ball State comparison contributed to a significant treat- 
ment effect when the analysis was made within the separate program conditions shown 

in Table 15* 
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TABLE 13 

Adjusted Deans for E and C class pupils on indices using rank-position scores . 









E 






C 




Preneasure Level 


low 


high 


ave. 


low 


high 


ave. 


Index 


E program 














Intrinsic 


BSP 


44.4 


49.7 


47.1 


46.3 


52.8 


49.5 


Interest 


UICSM 


47.6 


53.4 


50.5 


46.8 


52.2 


49.5 




SMSG 


46.2 


55.0 


50.6 

i 

* 


47.0 

1 


55.7 


51.3 




TOTAL 


46.1 


52.9 


49.4 i 


50.5 


53.5 


50.1 


Perceived 


BSP 


45.6 


50.4 


48.0 j 


48.1 


52.4 


50.2 


Utility 


UICSM 


1)8.2 


54.0 


51.1 


44.3 


53.4 


48.8 




SMSG 


U5. T 


53.0 


49.3 


48.9 


56.9 


52.9 




TOTAL 


1)6.5 


52.5 


49.5 


47.1 


54.3 


50.7 


Perceived 


BSP 


1)3.5 


52.7 


48.1 


47.6 


54.7 


51.2 


Knowledge 


UICSM 


1)8.1> 


51.6 


50.0 


45.3 


53.9 


49.6 




SMSG 


1)4.2 


53.1 


48.7 


45.5 


52.9 


49.2 




TOTAL 


45.4 


52.5 


48.9 


46.1 


53.8 


50.0 


Ease of 


BSP 


43.7 


51.5 


47.6 


48.9 


54.7 


51.8 


Learning 


UICSM 


45.7 


52.3 


49.0 


45.5 


55.1 


50.3 




SMSG 


43.1 


50.6 


46.8 


46.0 


54.0 


50.0 




TOTAL 


44.2 


51.5 


47.8 


46.8 


54.6 


50.7 



ERIC 



TABUS lU 

F-ratios from the analysis of variance over all E program comparison conditions for 
each attitude index r-p score* 





Scales 




Intrinsic 

Interest 


Utility 


Ease of 
Learning 


Perceived 

Knowledge 




d*f* 












Program 


2 




2.0 


2.8 


0.0 


.u 


Treatment 


1 




1.5 


2.0 


11.5** 


3.0 


Premeasure 


1 




92 . 0 *** 


125.7*** 


99* k*** 


79.2*** 


Program X Treat 


2 




2.6 


U.5* 


1.0 


2.8 


Program X Premeasure 


2 




2.1 


2.9 


.6 


.8 


Treat X Premeasure 


1 




0.0 


1.0 


.2 


.2 


Program X Treat 
X Premeasure 


2 




•2 


.9 


.8 


3.3 


Teacher 


3(t - 


1) 


3 . 2 *** 


1.5 


3.0*** 


1.9* 


Number of teachers 


t * 




~~ 8 


8 


7 


8 


Teacher X Premeasure 


3U - 


1) 


1.3 


.8 


1.6* 


1.9* 


Teacher X Treat 


3(t - 


1) 


.9 


2.0** 


2.5** 


.9 


Teacher X Treat 


3(t - 


1) 


.9 


.8 


1.3 


1.2 



X Premeasure 



* p <*05 

** p <*01 
*#« p <*001 



ERIC 
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TABLE 15 



F-ratios from the analysis of variance of each attitude index r-p score for each E 
program comparison condition* 





Intrinsic 


Perceived 


Perceived 


Ease of 


Program.. _ 


Source of Variance d .jf * Interest Knowledge .. 


Utility. . 


Learning. 




Treatment 1 5.0* 


8.2** 


2.0 


8.0* 




Premeasure 1 27.9*** 


59. 4*** 


19.4*** 


18.9** 




Teacher (t - l) a 1.5 


1.3 


1.0 


4.3 


ftan State 


Treat X Premeasure 1 .3 


.5 


.1 


.9 




Treat X Teacher (t - 1) 1.0 


.8 


2.4* 


2.1 




Premeasure X Teacher 1.0 


.6 


.5 


2.4* 




(t - 1) 

Treat X Premeasure .8 


2.1 


.5 


.6 




X Teacher (t - 1) 




_ . — - - - — 


« — 




Treatment 1 *6 


.1 


4.5* 


1.0 




Premeasure 1 26.6*** 


26.1 


48.5*** 


52.0*** 




Teacher (t - 1) 1.6 


1.1 


1.5 


1.0 


UICSM 


Treat X Premeasure 1 0.0 


5.8* 


2.4 


1.1 




Treat X Teacher (t - l) .4 


.5 


.9 


1.4 




Premeasure X Teacher .6 


1.0 


.7 


1.2 




(t - 1) 

Treat X Premeasure 1.0 


1.0 


.7 


1.6 




X Teacher (t - l) 




.. 


. — 


x ' ‘ * 


Treatment 1 »4 


.2 


4.8 


1.8 


5 


Premeasure 1 31.2*** 


15.8** 


67.1 


29.3*** 




Teacher (t — l) 7.1*** 


4.0*** 


2.0 


8.3*** 


SMSG 


Treat X Premeasure 1 0.0 


.7 


.1 


.1 




Treat X Teacher (t - l) 1.3 


1.7 


3.1** 


6.0*** 




Premeasure X Teacher 2.4* 


4.7*** 


1.3 


2.3* 




(t - 1) 

Treat X Premeasure *9 


.4 


1.4 


1.4 




X Teacher (t - l) 










a t = number of teachers (i.e. * 


p <.05, ** P 


<.01, *** 


p < #oox 



pairs of classes) indicated 
in the table of means for 
each measure. 
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ii. Perceived Utility 



For the index of Perceived Utility, the overall instructional treatment 
differences were not reliable, however, a significant program y 
action was obtained. As can be seen in Table 13, this resulted from the E class 
pupils instructed with the Ball State and SMSO Programs having lower se^es than 
those in the C classes with which they were compared while toe UI^ pupils had » 
higher mean score than those in their comparison classes. The of tte 

E-C differences for the separate program comparison conditions were exa^ned furth 
with the three factor (instructional treatment by premeasure by t^h«) < te 
variance design. The results of these analysis, which sreahowninTable 15 , indicate 

that only for the U1CSM program was the treatment effect 

that among the E programs, only the pupils instructed with the OTCai material 
exhibited a greater tendency than those instructed with toe conven than other 

to develop a perception of mathematics as having relatively more util y 

subjects . 



iii . Perceived Knowledge 



Some variation in the direction of the E-C differences for the; ^nowledae. 
exper imen ta l programs can be seen in Table 13 for the index of erce interactions 
Although neither the treatment ma: .j effects nor toe program by treatimnt inter 
reached toe .05 level of significance in toe analysis considering all prog^ 
parison conditions shown in Table 14, they were all Just beyond the .05 lev , • • 

p < .10. 



The results of the analysis for the separate E programs are shown in ‘state 

significant treatment effects were observed. Pupils instructed with the Ball State 
urogram had reliably lower perceived knowledge scores than those in the 
C classes. For toe UICSM program a significant treatment by ^ on 

was obtained. This resulted from the fact that among pupils at the lower 
the premeasure these in the UICSM classes had the higher mean while among pup 
toe higher level on the pressure, those in the C classes had a Wgher mean at the 
end of the year. A further teat to determine if the mean differences rithin each 
premeasure level differed frem zero showed that neither of these dif 
higher reliable. For toe lower P^asure levei E ’ C F ^ 

for the higher premeasure level, C > E, *-«•*» • J - u ^ 

interaction indicates that there was a greater relative gain in Z 6 

for UICSM instructed pupils who initially perceived their knowledge “ relatively 
l£ than for those wh^had initially perceived their knowledge as relatively high. 



These results in general indicate that at the end of the year »eiv e^^toeir 

’sj’sj; zszz *. other subjects 



- in the uxcSM program, those that had lower perceived knowledge 

“So; toe ye ”^elo^ a’perception of relatively greater knowledge 

in mathematics than did similar pupils in the C classes. 



►I 

Is 



o 

ERLC 



aum*m 



j 



35 



iv. Ease of Learning 

Ihe analysis across all E program comparison conditions (Table lujshowd 
a highly reliable treatment difference with pupils in the C classes having a h gh 
L^re as shown in tehle 13. H>is indicates that over all Program comparxson^ 
conditions, C class pupils reported greater learning ease for mathematics relative 

to other subjects than did pupils in the E classes. Considering ®®^that P for 
grams, the E-C difference for the Ball State comparison was largest while that for 
ihe U1CSM comparison was smallest. The analysis within each E program condition, 

shown in Table 15, revealed that the difference for the Ball ® e a K°?!2 B reaC )| the 
reliable, while the differences for the other program comparisons did not reach tne 

.05 level of significance. 

Reviewing the results obtained from the analysis concerned with the effects of the 
experimental programs on the several dimensions of pupil attitude toward o^^natic , 
itappears that They were quite similar for the two types of scores used. For both 
the r-p and a-v response scores, a consistently lower ease of learning score was 

obtained for pupils instructed with each of the E programs, 

most pronounced for the Ball State program. For the index of intrinsic 

when the r-p scores were used the results indicated a reliable tendency or e 

State pupils to have lower intrinsic interest scores than did the conventional c 

pupils. A similar but nonreliable trend was observed for the a-v scores obtained 

from this scale. No reliable E-C differences were obtained for either score on this 

scale for the UICSM and SI&G program comparisons. 

On the index of perceived utility, when either r-p or a-v scores verej used, the 
direction of the E-C difference varied significantly between the UICSM Program and 
the Ball State program. Both scores for UICSM instructed pupils were reliably 
higher than those for pupils in the comparison conventional classes. Hoover, only 
for the a-v score was the differer .e which favored the C classes in the Ball State 
comparison statistically reliable. 

On the index of perceived knowledge there was some variation in significant differ- 
ences indicated depending on whether the r-p or a-v scores were used. For the 
scares a treatment difference was observed only when the sexes were considered 
separately. The SMSG instructed boys had reliably lower a-v scores than those in 
the C classes. This was the only instructional treatment difference observed on 
these measures for the SMSG program comparison. When r-p scores were used, pupils 
in the Ball State program had lower scores than their C class counterparts . Also 
UICSM pupils having lower premeasure scores showed a higher perceived knowledge score 
at the end of the year than did similar C class pupils in contrast to the E-C 
difference for those having higher premeasure scores which favored the C class pupils. 

It should be noted, however, that most of these differences are not very large, in 
most instances accounting for a considerably smaller proportion of the variance than 
is accounted for by the premeasure of each of the variables. 
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Considering tbe results of the analyses to determine t&e direet^effeets 
experimental programs on indices of bo genera warranted. (1) The experi- 

in mathematics, several more general °*®® a u effect either positive or negative, 
mental programs appear to have a relatively sma ’ , t lea8t as indicated 

on the attitudes and interests pupils develop in theninth grade «* “•* ^ 

by the most direct indices of these attitudes the attitudes 

State program appeared to have a more negative than positive efrect on™e 

pupils develop toward mathematics than did ®^ 8 °“ a '° n ^^ Y Kowledge . 
instruction. This effect was most evident for the index of P ^ ll8 exhil) ited 
(3) The UICSM program was the only experimental program - in t he 

a tendency to develop more positive attitudesaovardmathemaUc= ^ 

comparison conventional classes and even for this program, ,, utility 

2l£d. The largest effect for the UICSM program was « t»de£y 1 tS pupils 

testwted with the* experimental materials to experience more learning difficulty 
than was reported by pupils in the conventional classes . 

B. Specific Instructional Factors Contribution to the Experimental - Conventional 
Program Differences. 

The above analysis has been ^^UvethL^sTn SS"l«s 

erent experimental programs or materials as indica y w resultant atti- 

attitudes toward mathematics over the year. Some di outcomes were however necesr- 

tudes toward mathematics were observed. The* 

sarily determined or mediated by ’ly of a number of mor pe Among these 

ticns which must have differed am ug the alternate ^“^^^^“fics or 
possible factors there were those that represented the distinctive chara^ 

factors* or r cSStiOM e S n Se"in8truction^Tsituatiai'which 1 ndght k ^OTe C contributed to 
the differences obtained. 

With respect to this question, ttnrn 

required consideration. Since they directly ref 1 p th instructional 

tional difference, qualities or Mrl*U<> atti- 

materials themselves are the most obvious and li X. involved such effects 

tude differences. However since other factors could ^ be inv^d^sucn ^ 

need to be demonstrated in terms of direct pup directly affected by the 

ials. A second set of factors are those associa . effort demands 

teacher as such. Grading practices, ^tructi-al approach SS 

m€y^ have^vSie? i^^systematic the E-C classes and thereby contributed 

to the observed differences. 

Because they involve factors most directly oLsileSd^iret 

pupil Judgments or reactions to their xnstructxonal detail 

iTsome detail. The teacher connected factors will he oiscusseu i 

below. 
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There were two questions to be considered with respect to pupil judgnentsconcerning 
the instructional materials (l) whether the judgments varied for ?*« 

C classes and (2) whether such judgment differences might have cootributed to or 
ccuM account for any of the more general attitude differences observed between E 

and C class pupils. 

Pupil judgments were obtained concerning the degree of difficulty using under 
standing the textbooks with which they had previously been instructed. 

Textbook difficulty 

Judgments of textbook difficulty ^ ^ 

indicated above but also because the most distinctive t-t Qirrerenc aourees 

for a more gene ral index of ease of learning which presumably reflected all a 
of learning'difficulty including that associated with the textbook as such. 

With respect to the latter index there is, then, the more specific question of 

« 

^s^acSr^^^ rS^alreLoT since 

^linglfftem ^xoftTxfbo* difficult* was one of the items comprising the 
more general Ease of Learning (EOL) index. 

- c differences in judgment of textbook difficulty were examined using the rank 
position response given ^pils to this item for mathematics 
* nA ^pnce The greater the rank position value, i.e. 3, the reiaxivexy 
the difficulty. ifLke an appropriate comparison, it was news** 
account the pupils initial (beginning of year) "f.^^^rekected 

^niils^rienre ^SSg'tte^'^thef than 7 his previous experience with math- 
materilu. Since no textbook difficulty judgment wm 
nine of the vear the rank position score on the premeasure of the EOL index vas 
“Sd for thif purpose. Comparisons were made within each E 
dition for pupils above and below the EOL premeasure ®f? 6 ° f th ® 

separately. The math rank position frequencies are shown in Table 16. 

It can be seen that pupils instructed ^^tlfi^^s^ire^nuS'al 
cated much more frequently than pupils mstructedvith t pe science 

assrrsssL - s- r ssas. 

L^^^Irecti^ E I C x^^ E ^3^ed^^rt^sfSd1nd^^k^siti« i fr^uencies 

Ss£ ^wM.assrs: : s 2S&SS s,h 

SSilS fl^^eT fSl^wW^^^SSminltiOT of the relative contri- 
SSaTto L overall x 2 of each of these factors. 



SThis item read, "how easy or difficult did you find it to understand the textbooks 
used in each of the subjects you have been taking. 



i 

?The two adjacent rank position categories 
terpretation because the categories had an 



could be combined and not alter the in* 
ordered relationship. Reducing to two 
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The frequencies for and results of this analyses are shown in Table IT. 



For both the Ball State and SMSG y 'TT l^f^n^S'Squfncylthfvalue for 

w-trsis jsss: s ; jS/ssts r 

& s« 

SS^^^C- t (x*a with p < 

s ^ o L^rsm^ri~ Sl> ^ ™ s 

indicate more text difficulty than girls. ”^® C { 2 °) observed for all 

expected learning ease (pre BOL) reliable differe U > leamlng difficulty 

programs. These differences indicate tha pup ^ , + er text diffic u lty than 

in general for math (low EOL) more frequen y ^P° initial pupil characteristics 

those in the high EOL category which was a reflection of initial pupil 

affecting both indices, as would be ejected. 



It is quite evident that the »!***«« that 
their materials as being relatively more difficult - v _ the uiCSM pupils 

of the conventional class pupils with whom they were ^no tendency 

there were nc real differences in this regard though there also was 
for the UICSM pupils to Judge their materials as less difficult. 



The next question to consider is whether th< , M *«erences 

index were mainly a result of the textbooh difficulty jud^ents or ^ Qf 

were other factors in the instructional situation contributing to p 
greater learning difficulty in general for pupils in the E class . 



To examine the differences between E and C ciasseswith respect 

with adjustments for differences in i eve is or categories using analysis 

EOL means were compared within te tbook Judgment levels or careg ^ 

ot variance. A variation of the analysis a ^1£™ollowed. 

treatment effects for the various attitude in ^ c 8 , , e and tex t difficulty 

For this analysis two the « 

with pupils pooled across teachers within P s Afferent E programs, 

differences for text difficulty Judgments varied anong the ditt ^ ^f^ted 

rarr^sas: ... - - 

text difficulty Judgments were considered are shown in Table 1 



response "cate gor ie s"permitte d an unambiguous interpretation of the direction of the 
significant difference between E and C classes. 



•»— - «- w— ~ r 1 •» g 2*2 2 SS , ”» 00l *“'' 

with pre EOL indicated by x 2 * independent of tne sex ana 

affects. 



9«ith one exception, a difficult to 

?he r »^s e ex f effect°s ofCc^ r the X tables show the adjusted means for the sexes 
combined, i.e. averaged over both sexes. 
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TABLE IT 



Text difficulty rank frequency comparisons 'between 
sex and pre EOL level. 



E and C conditions considering 



Ball State 



Low 

Pre EOL 
(a x ) 



High 
Pre EOL 
(U2> 



UICSM 



Low 

Pre EOL 



High 
Pre EOL 
(a 2 ) 



SMSG 



Low 

Pre EOL 
(ai) 



High 
Pre EOL 
(«2 ) 



# p <.05 

## p < . 01 
*## p <.001 




Male (bx ) | 



Fenale (b 2 ) 



t.d. rank 


E(c,) 


C(c 2 ) i 

f 


Tot 


E(cj) 


C(c 2 ) 


Tot 


i 

1,2 


2 


13 : 


15 


20 


21 


41 


3 


29 


2h 


53 


b9 


21 


,!1 




31 


37 


68 


69 


b2 ' 


111 




X 2 abc * 6.5* 


X 2 abc » 4.1* 


1.2 


22 


bl 


69 


13 


30 


43 


3 


22 


18 


1*0 


2b 


9 J 


33 




kb 


r 

; ir\ 
VO 


~109 


37 


39 1 


76 




X 2 abc * U. 7* 


X*abc = 11.9*** 


1.2 


11 


11 ; 


22 t 


7 


18 ! 


25 


3 


19 




37 


30 


33 


63 




30 


’ 29 


59 


37 


51 


88 




X 2 j 


abc 3 0.0 




x 2 , 


abc - 2.1 




1.2 


26 


29 


55 


l6 


18 


34 


3 


20 


15 


35 


11 


8 


19 




46 


44 


~ 90 


2T 


26 


53 




x 2 


abc a .5 




X 2 


abc * .2 




1,2 


6 


19 


> 25 


8 


2b 


32 


3 


27 


21 


1 48 

i 


62 


26 


88 




33 


uo 


73 


lo" 


50 


120 




X 2 


abc “ 5.7* 


X 2 


abc = 18 . 1 *** 


1,2 


15 


38 


53 


13 


3b 


47 


3 


bl 


20 


6l 


23 


9 


32 




56 


58 


iTu 


36 

« 


43 


70 



X abc * 15.7*** 



X 2 abc * 13.3*** 



Total 



56 

123 

179 

X 2 ab = 3.7 
11 ? 

73 

185 

X 2 ab ■ .6 



X 2 a * 5,9** 



47 

100 

147 

X 2 ab = .9 
89 
54 
lU3 

X 2 ab = 0.0 
X 2 a = 25.5*** 



57 

136 

193 

X 2 ab * .9 
100 
93 
193 

X 2 ab * 2.7 
X 2 a * 18.9*** 



X 2 abc = E - C comparison within sex x pre EOL categories 
X 2 ab “ Male - female comparison .within pre EOL levels 
X 2 a — Pre EOL level comparisons 






SUI- 
TABLE 18 



Ease of L earning index mean r-p scores adjusted for sex and text difficulty judgments. 





Text 




E 






c 




Ball State 


Difficulty 

Rank 


low 


high 


ave. ' 


low 


high 


ave. 


2,3 


40.7 


1)U. 6 


1)2.7 j 


1)2.7 


45.8 


1)1>.2 




1 


52.8 


60el 


56.5 1 

_ U9.5 | 


54.7 


59.0 


56.9 




ave. 


46.5 


52.4 


1)8.7 

\ 

1 


52.4 


50.5 


UICSM 


2,3 


ltl.6 


45.6 


1)3.6 


! 40.1 


43.4 


1)1.8 




1 


55.5 


59.8 


57.6 


* 54.2 

1 

! 1)7.1 


60.0 


57.1 




ave. 


W.6 _ 


52.6 


50.6 


51.7 _ 


1)9.U 


SMSG 


2,3 


Ul.9 


47.1 


1)1). 5 


j 1)1,6 


45.0 


1)3.3 




1 


50.2 


61.4 


55.8 


j 58.3 


58.0 


55.1 




ave. 


1)6.1 


54.2 


50.1 


! 1)6.9 


51.5 


1)9.2 



Intrinsic intere st index mean r-p scores adjusted for sex and text difficulty 
judgments. 



Ball State 





2,3 


1)3.1 


46.9 


45.0 


» 

! 

1 

\ 


41.8 


47.9 


44.8 




1 


52.1) 


55.2 


53.8 


50.2 


57.0 


53.5 




ave. 


1)7.7 


51.0 


49.4 


t 

! 

V 


46.0 


52.4 


49.2 


UICSM 


2,3 


45.1 


46.6 


46.8 


t 

1 


43.7 


46.6 


45.2 




1 


5t 5 


58.9 


54.7 




51.5 


57.0 


54.3 




ave. 


48.8 


53.7 


50.8 


\ 

i 


47.6 


51.8 


_ 49/T 


SMSG 


2,3 


45.6 


53.0 


49.3 


\ 


44.0 


52.5 


48.2 




1 


52.5 


60.7 


56.6 


1 

k 


51.9 


57.1 


54.5 




ave. 


49.1 


56.8 


52.9 


I 

1 

f 


47.9 


54.8 


51.3 




yiiik 



- 1 * 2 - 

The analysis or variance results are shown in T i>le 19* 

Inspection of .he adjusted Beans in Table 18 c f« ,ar !? > t 5L ! h ?“* f i^itter^duced 
that the E-C differences that had been observed an the EOL l g d e ^ text 

(Ball State) or tended to favor the E programs (UICSM and program for 

difficulty Judgments re taken into account. The analysis ac^^all^ f claB3 

which a significant treatment difference (F * 11# 5 » P * , a nop sign— 

pupils had been ^served when text difficulty was not considered, £owed a nonsign 

meant difference (F = .5) f«vo ng the E class 

considered. 10 The analysis within each program con^arison ccn^tion he 
the overall E-C differences to be significant whereas for the Ball V - v 

without considering the text Judguent a reliable ^jen’text 

favoring the C class pupils had been obtained <» the a reliable treat- 

difficulty and sex were considered for toe SMSG pro^am M^ , ’ ig coopar ing the 
ment by premeasure interaction was indicated. to l£v premeasure cat- 
SMSG E-C treatment conditions separately for pupils in higi and low pre learning 
egories indicated that among those anticipating relat v».±ly /« _ 3 9 

(Set pre EOL), E class pupils obtained reliably higher ^^^^‘Lan! «re 
p <..05} than C class pi5>ils. For those in the ^ + f F = eg) A similar 

in the opposite direction (OE> but were ^ni to which 

difference had not been observed for this program previ » V decree of text- 

scores on the 3CL indices ^ associated with or^em^ed^ e 4 obt<dned 

•book difficulty is indicated by the large and highly s gn 
for the latter factor# 

It is — ia*nt ts*t tl» instrocticiMl ii^StTsewlt 

z?£££ versa sarsaa- 

Instructional treatment cemparisens with '*1^° f Se^be r*att i tude indices, 
difficulty responses and pupil sex were s^o „ake E-C ccm- 

Analysis procedures similar to those f “ Utility and Perceived Knowledge r-p 

parisons for the Inatrinsic Interest, P^wi^d Utility an respect- 

index scores. The adjusted means for ^ m Tab le 19. 

ively in Tables 18 and 20, and tbe analysis of variance results 

For tbe index of intrinsic interest when text 

(p < .05) E-C treatment difference were indicated for any of tne^m p ogr ^ 
ever for each of the E programs t..e adjusted means ® ^ adjusted for 

larger than those for pupils in C ‘ pupils obtained lower means 

text difficulty, both tbe SMSG “? ,»>“ “ ^^ST^erLS being reliable at 
than their respective C class pupils, th “ difficulty differences 

the .05 level (F = 5.0). It appears ^‘f^^^thTBall State program, 
into account does alter somewhat Ike ®~ C f association between text diffi- 

culty SSSTS.- ^armXc^nterest S t^sic 

SSrsr*E5 ?ZSZ.-2Z2X£ - - - 

for the SMSG program. 

lO The results of the analysis over all E program comp ? ison ectli-iona are not shown, 
cn^ 6 those for the analyses within each E program condition. 
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TABLE 20 



Perceived Utility index mean r-p scores adjusted for sex and text difficulty 
judgments. 



Text 

Difficulty 
Ball State Rank 

2,3 



1 



ave, 

UICSM 

2,3 



1 



ave. 

SMBG 

2,3 



1 



ave. 



lo>. 


high 


ave. 


I*l *.8 


47.5 


46.1 


1*9. U 


56.2 


52.8 


1*7.1 


51.8 


1*9.5 


1*7.5 


51.8 


49.6 


50.2 


55.7 


52.9 


48.8 


53.8 


51.3 


44.2 


53.3 


48.7 


51.4 


58.6 


55.0 


47.8 


55.9 


51.9 



C 



low 


high 


ave. 


47.4 


1 * 8.8 


1 * 8.1 


50.5 


51*. 7 


52.6 


1*9.0 


51.8 


50.1* 


U3.2 


1*9.3 


1 * 6.2 


1*7.9 


5**. 9 


51.1* 


1*5.5 


52.1 


48.8 


1*5.6 


56 . j 


50.8 


1*9.7 


57.1 


53.1* 


1*7.6 


56.5 


52.1 



4 

1 



1 



Perceived Knowledge index mean r-p scores adjusted for sex and text difficulty 
judgments. 



Ball State 



UICSM 



SMSG 




2,3 


1 * 2.6 


1 * 8.1 


1*5.1* 

f 




1 * 2 . 1 * 


50.2 


1*6.3 


1 


1*8.3 


57.7 


? 

53.0 




53.0 


58.1* 


55.7 


ave. 


1*5.5 


52.9 


1 * 9.2 




1*7.7 


51*. 3 


51.0 


2,3 


1*1*. 5 


1*6.2 


1 * 5.3 




1*1.6 


1*2.2 


1*1.9 


1 


55.1* 


57.6 


56.5 1 


l 


50.9 


57.5 


54.2 


ave. 


5<U> 


. Jh$- 


50.9 • 


46.2 


1*9.8 


1 * 8.0 


2,3 


1*1.9 


50.0 


1 * 6.0 


l 


1 * 1.0 


1*7.5 


1 * 1 *. 2 


1 


53.2 


58.3 


55.8 


1 

t 

« 


50.5 


55.1 


52.8 


ave. 


1*7.6 


54.2 


50.9 


« 


1*5.7 


51.3 


1*8.5 







For the Perceived Knowledge index scores, adjustments for differences in textbook 
difficulty judgments and sex altered the nature of the dif cultv 
observed for each of the E program comparison conditions. When textbook 
judgments were considered, the adjusted means for the E class pup . enter 
greater than those of the C class pupils for both the UICSM (p < . 01 ) an 
(p < .05) comparisons. Also when text difficulty was considered for the Ball State 

comparison, the differences favoring C class pupils were nonsignifi can . 
difference had been significant (C > B, F » 8.2, p < .05) 

shown in Table 15 which did not consider text difficulty while the earlier differe 
for the SMSG program (C > E) had not been reliable. The previous ^jlysis f o. tne 
UICSM program had not indicated a reliable overall E-C diffemice but 
a significant treatment by premeasure interaction with E > C for those g 

initial perceived knowledge scores and C > E for those with higher initi 

These results indicate that when adjustments are made for differences in ^5**" 
culty judgments, pupils instructed with the UICSM and SMSG programs tendedto per- 
thefTkno^le^e of math to be greater relative to other subjects than 
pupils in the respective comparison classes. Similar comparisons o Here 

ted with the Ball State program showed no reliable differences in this regar . 
again no reliable sex differences were observed. 

There was no real change in the instructional treatment differences obtained for 
ttePerSived Utility scores when pupil sex and text difficuityfactors werecon- 
sidered. As observed previously, the UICSM pupils obtain^ reUab^ hi^r scores 
than their comparison C class pupils while there were no reliable . t ^ lv 

pupils in the Ball State or SMSG programs. This analysis did indicate co 
reliable sex differences across all programs (E and C) with bpys ^ textbook 

mathematics as having higher utility for future goals than £rls. Aj**^*^ 
difficulty did not apparently differentially affect the Perceived Util^y scores of 
pupils in E and C classes being compared, it is evident from the «neOy 
results that the Perceived Utility scores were related to this judgnea 
ins tructional materials. 

The results obtained with adjustments for text difficulty and se * + 

also examined for a snasure of general interest in mathematics, tteMken Interest^ 
scale. The adjusted means fc- ^ach of the E program comparison 

to Tailelt Sd the analysis of variance results in Table 22. means and results 

of this analysis could be compared to those presented in Tab es an 

For the Ball State and 6MSG programs there is a tendency for the E class 

both sexes to increase relative to the respective C class ne ? n ® ld 

factors were considered. These changes were not large enough however to yield re 

liable overall treatment differences. For the Ball Statecomporison 

treatment by initial interest by text difficulty toteraetdon was todierted. The 

best characterization of this interaction would seem to be that the degree o 

a bigger difference for those with higher initial interest to the E 
those^with lower initial interest to the C classes than for those 
with lower initial interest to the E and higher initial interest to the C classes. 

For the SMSG comparison, a significant sex by treatment by initial interest 
IrtiS was indicated which apparently resulted from a higher 

initial and post interest for E class girls and C class boys than for E class boys 
snd C class girls. 



TABLE 21 



Aiken interest scale means considering sex and text difficulty for each t program 
comparison condition. 



Ball State 


Premeasure 

Level 


low 


med 


high 


ave 


low 


med 


high 


Sex 


Text 

Difficulty 

Bank 
















M 


3 

1.2 


2.80 

2.88 


3.27 

3.65 


3.72 

4.21 


3.26 i 
3.57 • 


2.52 

3.12 


3.02 

3.62 


3.73 

4.05 




ave 


2.84 


3.U5 


3.96 


3.U2 

l 


2.82 


3.32 


3.89 


F 


3 

1,2 


2.55 

3.06 


3.18 

3.46 


3.31 

4.43 


3.01 | 
3.65 1 


2.39 

3.27 


3.24 

3.73 


3.91 

4.l6 




ave 


2.81 


3.32 


3.87 


3.33 i 
1 

3.14 ! 
3.61 


2.83 


3.49 


4.04 


All 


3 

1,2 


2.68 

2.96 


3.23 

3.55 


3.52 

4.32 


2.46 

3.20 


3.23 

3.68 


3.82 

4.11 




ave 


2.82 


3.39 


3.92 


3.37 . 


2.83 


3.40 


3.96 


UICSM 

K 


3 

1.2 


2.68 

2.88 


2.90 

3.67 


3.13 

4.31 


2.90 

3.62 


2.77 

3.29 


3.18 

3.66 


3.57 

4.09 




ave 


2.78 


3.29 


3.72 


3.26 


3.03 


3.42 


3.83 


F 


3 

1.2 


2.62 

2.90 


3.42 

3.71 


3.74 

4.34 


3.26 | 
3.65 1 

i 

3.46 | 


2.32 

2.61 


3.47 

3.52 


3.57 

4.15 




ave 


2.76 


3.57 


4.04 


2.47 


3.50 


3.86 


All 


3 

1.2 


2.65 

2.89 


3.16 

3.69 


3.44 

4.33 


3.08 1 
3.64 


2.55 

2.95 


3.33 

3.59 


3.57 

4.12 




ave 


2.77 


3.43 


3.88 


3.36 


2.75 


3.46 


3.85 


SMSG 

M 


3 

1.2 


2.57 

3.33 


2.96 

4.00 


3.94 

4.28 


3.15 

3.87 


1 2.57 
' 2.74 


3.07 

3.67 


3.78 

4.30 




ave 


2.95 


3.48 


4.11 


3.51 


| 2.66 


3.37 


4.04 


F 


3 

1.2 


2.32 

2.70 


3.23 

3.80 


4.26 

4.26 


3.27 

3.59 


2.43 

3.15 


3.28 

3.76 


3.50 

3.98 




ave 


2.51 


3.52 


4.27 


3.43 


2.79 


3.52 


3.74 


All 


3 

1*2 


2.45 

3.C2 


3.10 

3.90 


4.10 

4.28 


3.21 

3.73 


i 2.50 
J 2.95 


3.18 

3.72 


3.64 

4.14 




ave 


2.73 


3.50 


4.19 


3.47 


; 2.72 


3.45 


3.89 



ERLC ‘ 



i 



ave 



3.09 

3.60 

3.34 

3.18 

3.72 

3.45 

3.14 

3.66 

3.40 



3.17 

3.68 

3.43 

3.12 

3.43 

3.27 

3.15 
3.55 

3.35 



3.14 
3.57 

3.36 

3.07 
3.63 

3.35 

3.10. 

3.60 
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TABLE 22 



F-ratios from an analysis of variance o 
and text book difficulty. 



Source of Variation 


B.S. 


Treatment 


.08 


Text difficulty 


37 . 14 *** 


Pr ©measure 


62.63*** 


Sex 


.02 


T X t.d. 


.09 


T X Prem 


CM 

O 

• 


T X S 


1.36 


t.d. X Prem 


.16 


t.d. X S 


1.19 


Prem X S 


.02 


T X t.d. X P 


3. 27* 


T X t.d. X S 


.87 


T X P X S 


.21 


t.d. X P X S 


.73 


T X t.d. X P X S 


.40 



Aiken scale scores considering pupil 



UICSM 


SMSG 


.01 


2.57 


35.23*** 


46.56*** 


63.10*** 


104.13*** 


.06 


.36 


.84 


.02 


.07 


1.45 


4.62* 


.27 


2.33 


1.71 


2.70 


.86 


3.72* 


.95 


.95 


1.43 


.17 


3.18 


.41 


3.95* 


.45 


.57 


.74 


.46 



* p <.65, ** P 



^or each source of 
1 degree of freedom. 



variation there was 



<.01, *** P < 



For the UICSM caparison, the E-C differences over all pupils were not altered when 
sex and text difficulty factors are considered. However, with the adjustment for 
text difficulty a significant sex by treatment interaction appeared. The Aiken 
scale mean was greater for girls instructed with the UICSMprogranthan f or g5 rls 
instructed with the conventional program while for boys, those ^ 

conventional program had the higher mean. An analysis of variance for each of the 
sSH separately indicated however that neither of these differences was very reli- 
able F* 2.3, .10 < p < .25 in each instance. In the previous analysis a reliable 
E-C difference was found only for girls having lower initial interests. The latter 
difference was not found in the analyses for UICSM girls when text difficulty Judg- 
ments were considered which suggests that the adjustment for ths iatter factor work- 
ed in this instance in favor of the C class pupils. The malysis for P 

gram also shows a reliable sex by premeasure interaction which indicates that for 
carls initial interest was related more highly to post interest than for 
fact is also reflected in the higher F-ratio shown for girls compared to beys for 

the analysis in Table 3« 

Ho clear trends for the E-C differences were revealed on the Aiken scale for the 
Ball State or SMSG programs when text difficulty Judgments and sex were 
“h**, forthe UICSM program, a definite sex by treatment interaction 

was obtained. Girls in the E classes developed higher interests thanthosein t 
C classes while for beys those in the C classes developed the higher interests. 

For none of the programs were sex differences indicated on this measure of interest 
in mathematics. P The text difficulty factor did show a consistently reliable effect 
on »it.n scale scores for pupils in all instructional programs. 

VJhen the E-C comparisons were made considering pupil sex and Judgments about text 
S difficulty^ somewhat different instructional treatment difference^ppeared 
than had been obtained otherwise for the Aiken Interest scaleand thelntrin 
Interest, Ease of Learning and Perceived Knowledge indices. E-C dlfferenc * 
latter index were especially affected by this adjustment. For eac BCOres ’ 

the usual effect of the adjustment was to increase the magnitude “f^escor 
obtained by E class pupils relative to those in the respective C classes. This, u. 
effect, indicates that the factors for which the adjustoents were being 
and text difficulty Judgments, were reflecting or contributi g . u 

ences for these measures. Since the adjustment was made for two factors (as weii 
their interaction) there may be a question as to which factor was ^ 
of the changes resulting from the adjustment. Examination of the analysis ot var 
iance results indicates that text difficulty differences were c <“£ibuting much more 
to the variance and therefore to this effect than were the sex differences. 

It appears then that when comparisons were made between those who 

^ concerning the difficulty of their respective texts pupils ^“f^vTatti- 
the E programs exhibited on several indices a more Positive or a ^“ ® * t d 

tude toward mathematics than those instructed with C programs. The tendency 
development of relatively more positive attitudes appeared to g 
UICSM pupils and least for Ball State pupils. 

However, before it could be concluded generally that in the .absence > of text diffi- 
cultv differences the UICSM and SMSG programs would have had a positive effect m 
pupiL attitudes toward mathematics and the Ball State Program would not have con- 
tributed to a more negative attitude , other factors must be considered. 
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It was observed that the Ball State and SMSG pupils had a much ^ r< *® e ^ e “ d ti^ S e 3 
Judge their texts as being difficult to understand than did L * 

If this vere the case, then pupils in the E classes Judging their texts as being 
relatively less difficult sere more likely to be pupils that had relatively higher 
proficiency and/or higher grades in mathematics than the C class pupils Baking 
sane JudgrentV^That Is thf adjustment for text difficulty differences by equally 
weighting the alternate levels nay have resulted in a differential adjus 
tween E and C classes with respect to nathenatics ability or grades received in^he 
mathematics class. Since both of the latter variabl Le^specially the =eived, 

are relevant to pupil attitudes, partialing out the text difficulty diff re 
could have contributed to more positive attitudes for Eciass pupils independen^^ 
the effects of the instructional materials. This effect, soul ° grades, 

fleeted on the Perceived Knowledge index which correlates most bighlywith^a 
Under these conditions then at each text diffiq^ Judgmen t i£2Si the average 
oade for E class pupils would bThigher than that for C class pupils. If this were 
S^ved then pupil grades could account as readily for E-C 

Perceived Knowledge and possibly other attitude indices as ^“^ e d ^ r ^ ces . 
themselves when comparisons were made adjusting for text diffic y 

To examine this possibility on the index of perceived knowledge 

variation in results had been obtained, an additional analys is was ^ led out . 

E-C comparisons were made considering text difficulty leve s c Measures 

possi^ grade and proficiency differences using analysis 
of both of the latter variables and the premeasure of perc 
included in the analysis as covariates 

The results of the covariance analysis indicated n ^ r ® d | a ^ 1 t 2 E "^g^“t^ly)! ff For 
ences for the Ball State and UICSM programs (F » .86 and 1.02, respec a ^ 

the SMSG program the treatment difference was reliable, F 6>365 

the E class pupils having the higher adjusted mean perceived knowledge scores. 
Underlying this analysis is the assumption that the 

cients were homogeneous across the E-C treatment by text level cat 

gories. Ttest ft this assumption indicated that it clearly he “ 1 1 * ft " 
cotiid arisen (P * .57) but that it vas somewhat questionable for the Ball ^ 

(p * .10) and SMSG (p = .lU) comparisons which suggests some caution rp 

ting the covariance results for the latter two programs. 

On the basis of the analysis of covariance “ inLx^^adJusted" for 

observed in the UICSM comparison on the Received J? , ena/or achi- 

difficultv differences were primarily the result of profici y ' „ 

evenen^ factors For the Ball Stlte and SMSG programs hoover, ^"atro^of 

proficiency and achievement in conju^tion with text cc ^ s |dered alone. This 

aaa nnf oitpr the effects observed when text difficulty was . 

st5££wjssws s sasr=ara«. 

^Tpupils would obtain higher perceived knowledge scores than those instructed 
with conventional programs. 



U A special computer program for the covariance analysis with three covariates was 
written by Mr. Rodney Rosse. 
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These results suggest further that the somewhat negative effects observed for the 
Ball State program and the lack of positive effects for the SMSG program on other 
attitude indices may have been primarily the result of differences in the di 
pupils* experienced with the instructional materials. 

2. Teacher determined conditions - 

a. Pupil grades 

The grades pupils' receive in a subject are quite likely to have sene affect on their 
attitudes toward the subject matter. Within a given class .grades^nodoubtquite 
highly related to independent measures of the pupil's relative proficiency or ability. 
U is pSsible however, independent of actual proficiencies, that teachers 
have varied their grading standards between the separate clas of 

Such variation would be more likely when teachers were using di / P ^ 

instruction in separate classes which, to the extent that the instruc on ® ? J 
ves differ, might require judgments relative to different perforce ' 

this were the case in the present study, it could result in “ ^ * 
tribution of grades assigned respectively to the E and C class pupi . _ ai _ 

question then as to whether there was any systemat’ c difference in e gr * 
gned to pupils in the E and C classes when any previous mathematics class perfo 

differences were held constant. 

Information concerning the average or overall grade received in ^hematios during 
the previous (8th grade) and concurrent year was obtained for pupi.* *» » 
of classes participating in the study. To determine if there were any £■* differ 
enccs between the E and C class pupils, comparisons were made Inalvsis was 

comparison condition using the three factor analysis of 

restricted to class pairs for which the necessary data was avails . 

sequently reduced the number that could be included in each ^thf^era^te 

Table 23 shows the adjusted grade means for pupils instructed with measure 

programs and Table 2k shows the results of the analyses of 

The analyses provided no indication that there were any overall differences in 

gradesreeeived by pupils in the E and C classes for each E 

dition. It does net appear then that any instructional treatme 

served with respect to pupil attitudes could be attributable ° x ' 

matic differences in grades received by E and C class pupils respectively. 

A moderately reliable teacher by treatment interaction v&s °^?**i^ e in 

Ball State and UICSM program comparisons. This result indica+es ^** icn 

the magnitude and/or direction of the E-C grade differences t «en teacher 

Whether the teacher by treatment grade differences oorrespon . analvsis. 

tre atmen t differences on other measures will be considered in a subsequen alv 

b. Teacher attitudes and judgments concerning the E programs 

Another instructional factor “^‘“jigi^^^asses^was^he^jud^ent 3 ©!^ attitude^of 

Z £££ IS used? SS A S chSacter i zatirai of the materials 

by the teaoher to the^upils, either in general e ^" a «! e . t *“ 8 « ^ ^ 

anticipated instructional outcomes or purposes could affect the pupils reaction 
“tter the materials or to the subject matter itself. Such a characterisation 
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TABLE 23 



Adjusted grade means for E 



and C class pupils in each E program comparison cod it ion. 

C 



Treatment 



E 



Experimental 

program 


Number of Premeasure 

class pairs level 


low high 


ave. 


low 


high ave. 


Ball State 


8 


3.lfc 5.36 


4.25 


3.26 


5.15 

4.22 


UICSM 


5 


3.02 5.^2 


4,22 


3.75 


5.74 

k.lk 


SMSG 


8 


3.96 5.^8 


4.72 


3.45 


5.48 

4.46 


Values assigned letter grades i 










A s 1 
A-, B+ * 2 


B * 3 
B-, C+ * 4 


C ® 5 * 
C-, D+ * 6 


11 


7 

8 


F * 9 






TABLE 24 








F-ratics from the analysis of variance for pupil grades in each program 


comparison 


condition. 




B.S. 


UICSM 




SMSG 


Source of Variance 








Treatment 


1 


0.0 


1.4 




2.3 


Premeasure 


1 


119.1*** 


21.0* 




52.7*** 


Teacher 


(t - l) a 


6.U*** 


17.6*** 




6.2*** 



Treat X Premeasure 

Treat X Teacher 

Premeasure X Teacher 

Treat X Premeasure 
X Teacher 



/+ 
\ v 



<t - 
(t - 



1) 

1) 

1) 



.9 

2.5* 
.6 
• 9 



.7 

3.0* 

3.7** 

.2 



2.2 
1.2 

2 . 0 * 

.5 



a t * number of class pairs for each 
program condition indicated in 

Table 23. 



p <.05, ** P <.01, *** p <.001 
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would be especially likely in the E classes because the 

different. As part of the more extensive project concerned with the effects of 
E programs on pupil achievement in mathematics, a questionnaire ha <* ***?* 

to elicit participant teacher Judgments and reaction to the experimental instruc- 
tional materials they were using. Prom the questionnaire items .everai scaies were 
derived The questionnaire provided indices of (l) the teacher Judgmen 
relative extent to which the E and C programs achieved certain ^ s ^ C /|? n fJ e 0 ^ ac ^ 
tives. (2) The teachers preference for E relative to C materials (3) 
ers Judgment of the pupils reaction (in general evaluative terms) to the materi 

and the subject matter. 

To this question , a single index representing the E-C class difference (ad- 

lustedTor premeasure differences) on each of the attitude scales for each indivi- 
ual teacher was obtained. The degree of association between the teachers adj 
f r rlans difference score for each attitude index and teachers score on each of 

rrTbiSt e y ts« 

( U is there 

spcndence between the individual teachers Judgme nts conceding < the E pr< ogram d th 

e!c class differences on any of the pupil attitude indices. It 

there is no evidence that the teacher attitudes ^ ^^iL^i^erences in atti- 
teacher questionnaire indices were related to or affected tlk. differenc 

tude observed between the E and C classes e 

C. Instructional treatment effects considering moderator variables 

s' |“^"3r*srrr. 

Son aa moderator variables, in the sense that they interact vita the instructional 
program variations, to alter or modify their effects. 

On the basis of more general considerations different attitude »*£teresc 

^ these ^orrrrSsXfcTc; JTSS^S^I effects for 
the separate instructional progrrms. 

1. Pupil characterise 's 

In the previous analyses sex differences in att utility 
index^TOnsistentl^Mghe^score'^was obtSTed ^ot^S 

liable difference- were observed "tore frequently for girls in the analyses using 
2f£r “SST «'t5T Intrinsic Interest. Utility end Ease of Earning indices. 
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Another indication of pupil sex as a moderator variable was observed on the Aiken 
scale for the UICSM comparison. This appeared in the initial analysis for the Aik 
scale shown in Table 4 for which a reliable treatment by premeasu re effect was ob- 
served for girls but not for boys. It also appeared when E-C comparisons were made 
on the Aiken scale adjusting for text difficulty differences. The latter analyse 
indicated that girls instructed with the UICSM program developed more P 08 **^*! * ~ 
terests than those in the comparison C classes while the boys showed an E-C dr- 
6 r 6 DC 6 of similar ni& 0 iitud 6 in the opposite© direction* 

With respect to mathematics ability or proficiency as a possible moderating variable, 
the question is whether the E programs affect the attitudes of pupils h ^ving rela- 
tively higher and lower proficiency in any differential way. This question derives 
from logical as well as empirical considerations. In a separate questionnaire, 
distributed to obtain their reactions to the experimental programs they 'were teaching 
and Judgments of their pupil* s reaction to these materials , teachers were asked o 
indicate, for high, average, and low ability pupils separately, whether those in the 
E or C classes responded more favorably to their respective materials. A high pro- 
portion of the responding teachers indicated that among higher abili y 
response was more favorable for those in the experimental class, whxle among low 
ability pupils the response was more favorable for those in the C classes. VS 

Ryan and Rising ( 9))* 

The judgment probably represents a belief that the somewhat greater f ** 

conceptual aspects of mathematics in the E programs would -awe learning 

to lower ability pupils, while the somewhat more rote computational sad rule learni g 

character of the conventional programs would have relatively less appeal to the high r 
ability pupils. If true, then an interaction between ability and P * 

gram should he indicated on a measure of interest such tnat among lower ability p p 

those in the E classes would have less interest at the end ° f J^Vcl^ ss^awculd 
in the r, classes, while among hi^er ability pupils, those in the E classes would 

have the greater interest. 

To examine this question in general, comparisons were made for each °^LetITin 
attitude and interest indices; the Aiken scale - one of the measures of general in- 
terest, and the Intrinsic Interest, Perceived Utility and Perceive d ' f^tti rent ' 
Since as discussed above, seme evidence has appeared indicating that the treatment 

effects on pupil interest might he modified by sex dl "”® nces * 1 Whether 
included in the analysis to examine this possibility further and to det rm 

there was a sex by ability interaction. 

The pupils score on the mathematics section of the STEP obtained at the te ^ning of 
the year served as a measure of mathematics ability or proficiency, e comp 
ZJZe M analysis of variance within each E program eeorftttlo.. Four fact ors^ 
were considered; instructional treatment (E or C), pupil sex, ^ initiaMpre) 1 
of proficiency ^nd of interest, the latter being the premeasure of pendent 

variIble?For each of the latier two measures, two levels determined by the medisn 
of the distribution of scores of all pupils on each were used. 

Tn this analysis . if the treatment effects did vary generally wi*h the pupils* ini- 
tial^levelof S prof iciency with sex or with both factors, this would be indicated by 
S bv proficienev, treatment by sex, or treatment by proficients. 
w^l! ^ L^to^ respectiW.^kb ' Xe 25 shows th? adjusted means on each of the 
attitude indices 'for pupils having higher and lower levels of proficiency within sex. 



TABLE 25 



Adjusted interest index means for E and C class pupils by sex and level of pro- 
ficiency in math for each program comparison condition. 

Intrinsic 

encv Aiken } 



UICSM 



N 



All 



SMSG 



M 



All 



Math 



Interest 1 



Perceived 

Utility 
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Ball State 


Level 


E 


» 

c . 


E 


c i 


E 


c 


Sex 


lov 


3.13 


3.23 


46.4 


49.** ! 

• 


U7.U 


52.1 


M 


high 


3.58 


3.59 


49.2 


51.7 


51.3 


53.5 




ave. 


3.35 


3.M j 


j 47.8 


50.6 


k9.3 


52.8 




low 


3.02 


3.37 ] 


j W5.1 


48.0 


U8.X 


48.3 


P 


high 


3.53 


3.66 ' 


: U 9.0 


51.8 


U7.0 


51.0 




ave. 


3.27 


3.51 


• 

• 

ON 


49.9 ! 


! U7.5 


49.7 




low 


3.08 


3.30 


1 116.2 


48.7 


U7.7 


50.2 


All 


high 


3.55 


3.62 ! 


1 U 9.1 


51.8 


49.1 


52.3 




ave. 


3.31 


3.W | 


\ U 7.7 


50.2 


1 48.4 


51.2 



low 


3.10 


3.23 


i 

| 


48.7 


49.4 ; 


51.7 


49.1 


high 


3.45 


3.64 


I 

1 


52.4 


| 

51.5 1 


| 53.2 


53.2 


ave. 


3.27 


3.43 


. 


50.5 


50.4 | 


52.4 

j 


51.1 


lev 


3.36 


3.16 


■ 

1 

1 


48.2 


49.0 


49.4 


45.4 


high 


3.51 


3.52 




52.1 


50.7 


50.8 


50.9 


ave. 


3.44 


3.34 


i 

1 

t 

l 


50.1 


49.9 


50.1 


48.1 


low 


3.23 


3.19 


1 

4 

1 


48.4 


49.2 


50.5 


47.2 


high 


3.48 


3.58 


4 


52.2 


51.1 


52.0 


52.1 


ave. 


3.35 


3.39 


* 

* 


50.3 


50.1 


51.3 


49.6 



low 


3.10 


3.43 j 


48.4 


51.0 


1 


50.2 


52.5 


high 


3.52 


3.40 


54.3 


54.5 


1 

1 


52.5 


53.4 


ave. 


3.30 


3.41 


51.4 


52.7 


1 

1 


51.3 


52.9 


low 


3.11 


3.31 


49.2 


51.2 


i 

1 


47.3 


52.6 


high 


3.23 


3.44 


51.9 


48.6 


50.1 


50.3 


ave. 


3.17 


3.37 


50.6 


49.9 




48.7 


51.4 


low 


3.12 


3.37 


48.8 


51.5 




48.7 


52.5 


high 


3.37 


3.42 


53.1 


51.6 




51.3 


51.8 


ave. 


3.24 


3-39 


50.9 


51.3 


1 50.0 


52.2 
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instructional treatment, and E comparison condition categories. Tables 26 and 27 
show the results of the analyses of variance for each of the indices. 

As can be seei^ for none of the interest measures were the specific lower order inter- 
actions indicating a general moderating effect for pupil proficiency and/or sex 
significant at the .05 level or less. There was a tendency for the differences to 
be more in favor of the C programs among those with lower than higher proficiency 
for the Ball State pupils and SMSG males on the Aiken scale. A similar tendency 
was noted for the SMSG comparison on the Intrinsic Interest and Perceived Utility 
indices. For the UICSM program on the Perceived Utility index the trend was in, the 
opposite direction, lie., the E class mean being relatively higher for the lower 
proficiency pupils. Hone of these differences, however, were large enough to yield 

reliable effects. 

A variation between the E-C differences for the sexes for the UICSM program compari- 
son on the Aiken scale which was noted above also appeared in this analysis but was 
not significant . Apparently the adjustment for initial proficiency ^ff e ff nce ® “ 
not affect the sex by treatment interaction in quite the same way as did the adjus - 

ment for text difficulty differences. 

For the Aiken scale, two higher order interactions were indicated; a treatment by 
proficiency by premeasure interaction for the UICSM program comparison and an in- 
teraction involving all four factors for the Ball State program. Neither of these 
interactions appeared to reflect an easily interpretable pattern of effects ana 
since the analysis was concerned primarily with more general, i.e. lower order, in- 
teraction effects no further comparisons were carried out. 

In general, on the basis of this analysis, it does not appear that the effects of the 
experimental programs vary between pup. -s having different levels of proficiency 
mathematics at the beginning of the year, i.e. , mathematics proficiency does not 
moderate the instructional program differences. 

This analysis also did not provide any more conclusive evidence that there vere any 
differential treatment effects associated with sex differences. The tendency for a 
sex by treatment interaction in the UICSM program comparison condition on the Aiken 
scale was consistent with a separate analysis but did net appear in this instance to 
be very reliable. This effect as observed in the previous analysis may, however, have 
been a result of factors discussed below. 

The analyses considering initial pupil ability and sex, however, revealed other 
differences which have more general implications concerning the instructional 
treatment effects. It can be seen in Table 26 for the SMSG program comparison on the 
Aiken scale that a reliable treatment difference was indicated which was the result 
of higher mean scores obtained by pupils instructed with the conventional rather 
than the SMSG program. This difference had not been found to he as large nor as 



l*For the UICSM program, in terns of E-C differences the interaction reflected a 
difference in favor of the E class pupils for those low on preneasures of both 
ability and interest or high on both preneasures while the difference favored C class 
pupils in the remaining two cross classification categories. 



0 



I 
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TABLE 27 



Besults of analysis of variance of Perceived Utility index (r-p) scores withineach 
experimental program condition considering pupil sex end proficiency in mathematics 

Ball State UICSK • SMSG 







Mean 




Mean 




, Mean 


T3 


Source of Variation 


d.f . 


square 


F 


square 


F 


; square 

1 


F 


Treatment 


1 


31.6 


8.4**' 


10.8 


2.3 


i 18.5 

i 

16.9 


6.3* 


Sex 


1 


24.4 


6.5* 


28 . U 


6.0* 


5.7* 


Math Proficiency 


1 


11 . T 


3.1 . 


39.3 


8.2** 


, 3 .U 


1.2 


Premeasure 


1 


60.7 


l 6.1**» 159.0 


33.3*** 305.9 


103.3*** 


T X S 


1 


1.9 


.5 


.5 


.1 


1.4 


.5 


T X MP 


1 


.4 


.1 


11.0 


2.3 


; io .5 


3.5 


T X P 


1 


.3 


.1 


‘ 6.9 


1.5 


i 

1 3 .b 


.1 


T X S X MP 


1 


10.5 


2.8 


.7 

♦ 


.2 


1.1 


T X S X P 


1 


5.1 


1.4 


’ 9.8 

> 


2.1 


*» 3.3 

f 

• 


1.1 


T X MP X P 


1 


4.3 


1.2 


.1 


.0 


1 1.6 
1 

.0 


.6 


T X S X MP X P 


1 


1.5 


.4 


| 3.6 


.8 


.0 


Residual 


4 


4.1 


1.1 


1.9 


.4 


2.5 


.8 


Adjusted 


d.f. 


396 




321 




399 




error 


M.S. 


3.8 




4.8 




3.0 
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, . / i •_ fahies 2 and H) which b&d not considered 

reliable in the previous analysis ( . . , with) ounil ability or sex, but 

(i.e. adjusted for possible differences associated with ) pupil ani^y ^ 

bad considered teacher differences. Moreover, a c 8 for the E piograms 

nitude and reliability of the inst^i^^treat^nt vhen 

was also indicated for the index of P^ceived u ^y ^aiysis, reliable E-C 

sex and initial vroticienzy ^ SMSG comparisons with the C class 

differences were indicated in the Ball State ana » ^ thou ^ m the previous 

pupils having the higher nean score ® ^ ^ in the same direction, they were 

analysis (shown in Table 15) thesedifferei in the analysis (shown in Table 

not statistically reliable. For the UI CSM 1 vre^mla^m^ non-significant by 

IU c!Titfrf« S^eSTthea h*) appeared in the previous analysis. 

The difference in outcome between the two analyses could be due to either or both 
of two conditions: 

1) A variation in the E-C differences for indi^dual^teachers^for^who^^ted for 

^sVs 

been reflected by a reliable teacher by treatment interaction. 

ai . wm. > «v 2raS , i5 , »’3S , XfiT5S’!S« 

or both of the factors (proficiency and/or sex) adjusted out by the 

correspondence with the dependent variabie thathad nobe direct- 

preoeasure control variable. The process ^Uo^^forthe^enaly ^ & ^ 

ed toward nininizing E-C dllTerences with r ^pect ^ E . c differences with 

index. These procedures should also have . v . n _ n( .teristiC8 which happened to be 
respect to any other beginning-of-year pupll cha racteristics whlch ^ h -_ 

correlated with the dependent variable turning that It may ha ve been 

ghly correlated with the pre “t® u ^®° ^ de ^sufficient control or adjustment for 
that the analysis procedures did nc J h sex or initial proficiency on 

ri:^ f orfhfin£ 

to the post than the preaeasures of the variable. 

.. 1. - «. S & 1 

interpretations they would permi ^ rw th i s index for the UICSM compar- 

Of tZ differences for the separate E progr®. aependent variable 

ison both proficiency and sex appear to r teacher by treatment interaction 

as indicated by the main effects for e**, whUe no^ teacher by plausible 

was indicated. This leaves the sex and for the UICSM program 

explanation for differences obtained by the separate anaiys 

c omp arison. 

The latter possiblity is supported fur ?? e ' -^orti^of St^Mles* and higher pro- 
ncien^ls^^Srfof^h Sries tending to have higher scores) in the 
UICSM classes. 

For the SMSG and Ball State ^For^ac^o^these comparisons , the dis- 

r ri ^ “wiTh ^rp-ici^t; . s c « - 



4 



% 




the Ball State comparison there was a higher proportion of males in the C classes. 
Consequently for these programs either of the above conditions may have contributed 
to the variation in results. 

The occurrence of an overall difference in the sex and proficiency distributions 
however does not unequivocally indicate that these factors are accounting for the 
variation in treatment effects indicated by the analyses since the analysis design 
could have controlled for some variation in these factors. A more extensive analy- 
sis providing for direct control on the possible effects of each of these factors 
would be required to determine the nature of the E-C differences in more precise 
terms. 



For the most part the results observed with respect to the treatment differences 
when pupil sex and proficiency are taken into account affect primarily the conclu- 
sions that can be made for the T TICSM program on the Perceived Utility index. It 
appears that the reliably higher score indicated for UICSM instructed pupils in the 
previous analysis may have been due in cart to factors other than the instructional 
program. On the other hand 9 for an analysis on Perceived Utility scores across all 
E program conditions, a reliable treatment by program interaction (F - 6.1, 

p < .01) was again obtained when pupil sex and proficiency were considered. The 
latter interaction reflected the variation in the direction of the E-C differences 
between the UICSM and the other E program comparison conditions which had been 
observed in the previous analysis shown in Table lU. 

2. Teacher experience with the experimental programs 

It would be reasonable to expect that as teachers had additional years experience 
with a new program of instruction, such as the E programs, they would be in a 
better position to impliment the instructional objectives specific to that program 
and probably reduce somewhat any special difficulties or additional effort required 
in connection with its use. To the extent that such factors affected pupil atti- 
tudes either directly or indirectly, they would contribute in general to greater 
variation in E— C differences among teachers having differing amounts of experience 
and specifically to greater differences in favor of the E program for classes of 
teachers with more experience. 

On the other hand, however, over time there might be a tendency, due in part to 
increased familiarity, for the teacher to introduce some of the more positive 
characteristics of the E programs in his conventional classes. If this were the 
case smaller E-C differences in pupil outcomes affected by these factors would be 
expected. A question exists therefore, as to whether E-C differences for the 
measures obtained did vary between teachers having more or less experience with the 
respective E programs they were using, and if so, whether there were reliable E-C 
differences for classes of teachers at one experience level which had not been 
indicated generally. 

In the previous analyses for each of the attitude indices, individual teachers were 
treated as levels on a separate dimension. Consequently if auy teacher connected 
charateristics contributed to a reliable variation in the treatment differences this 



13^ similar analysis was also carried out for the Perceived Knowledge index with 
the results being very similar to those obtained for the earlier analysis sh*nra in 

■Table 15* 



o 
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effect would necessarily be reflected in the analyses by a sigiificant teacher by 
treatment or teacher by treatment by premeasure interaction. Conversely , nonsigni- 
ficant teacher by treatment interactions would indicate that there were no rea 
variations across teachers with respect to E-C differences which could be attributed 
in teacher characteristics. 



Examining the results of the analysis carried out for the separate attitude measures 
in which the teacher effect was treated as a separate dimension, only for the follow- 
ing measures ^nd E program comparison conditions were signific ant teacher by trea - 
ment interactions indicated: Perceived Knowledge, s-r score, Ball State; Perceived 

Utility, r-p score. Ball State and SMSG, and Ease of Learnirg, r-p score, SM5G. 

Where the previous analyses indicated a significant teacher by treatment interaction, 
a ddi tion a l analyses were carried out to determine if the between teacher varj.a on 
in E-C differences resulted from or was associated with differences in teacher 
experience with the E programs. 

For each of the above measures and E program conditions, teachers were classified 
according to their relati/e level of experience and the reliability of the E-C 
treatment difference within each experience level was determined using analys so 
variance within each experience level. The adjusted means being compared and the 
pertinent results of the analysis are shovn in Table 28. 

For the Ball State and UICSM programs on the Perceived Utility index (r-p scores) 
and the Ball State program on the Perceived Knowledge index (a-v scores;, none of 
the within experience level treatment differences reached the .05 level of 
ficance. It is evident though that in each of these instances the classes o e 
most experienced teachers tended to exhibit the smallest E-C differences. The 
r« thin experience level comparison for the SMSG program on the EOL ( r ~P scores 

did however show a highly reliable treatment difference for classes of teachers 
having the most experience with this program. The latter result indicates a 
the tendency observed more generally for E class pupils to experience greater earn- 
ing difficulty occurred for SMSG instructed pupils in classes of teachers having 
the most exoerience with this program. On logical grounds it would seem that a 
difference of this type would be more likely among classes of teachers having less 
rather than nci*e experience with a specific program. 



D. Properties and relations among attitude & interest indices and other measure s 

As discussed above there are some general questions of a methodological nature that 
should be considered concerning the various attitude and interest measures use 
the study which are relevant to the effects observed. 



There is a question of reliability or how well or consistently the indices provided 
measures of the characteristics they were intended to assess. 



There is also the question of validity of the indices used. In the context of the 
objectives of this study this question concerns the degree to which the separate 



14 The teacher by treatment effect was elso obtained on the Aiken scale for girls 
alone. However this effect was not examined further since the teacher experience 
factor would be presumed to be a factor affecting both sexes. 
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TABLE 28 



k-v. 

% 



within levels of teacher experience with E program. 



Treatment 
iio. of adjust, 
tchrs. rcan3 



, differ. Treatment , Error 



F 

ratio 



E 



C , E-C'-'.S. d.f. i ".S. d.f. , 



Results of 


analysis 


of variance 


Index 


E 

program 


years 

exper. 


Perceived 

Utility 


Ball 

State 


A,2 

3 


Perceived 

Utility 


S M Sf- 


1 

2,3 


Ease of 
Learning 


S T *SU 


1 

2,3 


Perceived 

Knowledge 


low 

premeasure 1 ,2 


Ball 

State 




3 




high 


1,2 



premeasure 

3 



3 U7.1 51.0 ' -3.9 I ^5.5 

5 U8.5 ^9.8 | -1.3 1 8.6 

t i 

i 

l \ 

5 k9.2 5U.0 | -It. 8 *112. k 

3 U9.6 51.2 -1.6 | 7.8 

} 

5 U7.1 U9.3 -2.2 | 2U.5 

3 It6.lt 51.1* -<t.7| 66.U 

I 

t 

5 8.1 9.2 ' -1.1 3.33 



1 


2U.3 


2 , 


1.9 


1 


20.5 


U 

i 


.h 


1 


30.5 


u 


3.7 


1 


6.6 lUl 1 


1.2 


1 


1 

> 

{ 71.6 


i 

1 

U 


.3 


1 


t 

1 6.6 lUl 

i 


10.0*** 


1 


i .96 


k 


; 3.5 


1 


1.92 


2 


.1 



3 


8.1 7.9 , 


.2 


10.6 


10. k 


.2 


10.3 


10.6 


-.3 



.09 

A preliminary test indicated 
no reliable variation in E - C 
differences between teacher 
experience levels, therefore 



i 





attitude and interest indices are SSTSTL^STSUs 

^“^s^ine ~^ed^r^Lpendent of perforce or achieve^nt character- 
istics and more general academic attitudes. 

1. Reliability 

c^Ut^cf^ f^rThfv^foTindi^L^fsu^s that 

were used. 

- ~.n^-?n +v rrf the various attitude indices over tim e , 

To obtain an estimate of the reliabili y it in the indices was ad- 

the Pall version of the questionnaire of 200 ninth grade al- 

ministered twice within a three «»»«»“ _ ^ th ^ain study. Product-moment 

eehra pupils in three schools not ^^^te-vllue end rank-positicn scores on the 
correlations were coated f Se test-retest reliability 
indices derived from the questionnaire ^spon separate indication 

^efficients for the "retest" sample ere ^.^^^^Xed for the data 
of the stability of the indices over the school y obt ained from the 

F^tndlpriSg querti^re^ tW These are shown in Table 31). 

Internal consistency ejffldwt ^ f ^^f 1 ,^^ e irSe^TrK 1 “ Sine ^ 
Hoyt reliability formulas found in cronoacn, 

Internal consistency reliabilit y w mcie^s wre co^ute^ep^at^ version ) to 

ces from the first and se« administra Uon the^que ^ ^ FaU md 

the retest sample shown in Table 3 actual data sample shown in Table 29. 

Spring versions of the questionnaire ^ ^ ^ rank position (3 sub- 

These coefficients were computed fo J.^ h * ^ reiiahilitv coefficients in- 

jects; EBglish, science and mathematics) sco gu ^ fi ™ ently inte rnally consistent to 
dicate that each of the separate indi u f purposes of group compar- 

provide an adequate measure of a pupil characteristic v 

ison. 

2. Relations between indices 

tion scores respectively. 

Considering the correlati^ aV 

logical classificSion Xh would dist^ish ^^“^^e^lchL^t 

raawer per se - indices of intrinsic 



15 This procedure utilises analysis of variance considering the within pupil item 
response^variance and the between pupil score variance. 



The Hoyt formula is: 



MS between pupils - M S within pupils 
r ll = MS between pupils 
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TABLE 29 



Coefficients of internal consistency obtained for the attitude and interest measures 
from the data sample (N * 1100). 



Measure 


Fall 

a-v 


r-p 


Spring 

a-v 


r-p 


Aiken scale 


a 


- 


96 


- 


Intrinsic Interest 


78 


90 


81 


86 


Perceived Utility 


77 


75 


83 


75 


Perceived Knowledge 


72 


76 


78 


86 


Ease of Learning 


73 


71 


89 


87 



a Computed only for spring administration 



TABLE 30 

Reliability coefficients obtained for the attitude and interest indices from the 
"retest” sample. 



Measure 


Test* retest 
a-v r-p 


Aiken scale 


81 


- 


Dutton scale 


6U 


- 


Intrinsic Interest 


70 


6o 


Perceived Utility 


5k 


50 


Perceived Knowledge 


61 


65 


Ease of Learning 


68 


61 



Internal Consistency, 



First Admin 
a-v 


r-p 


Second Admin, 
a-v r-p 


a 




a 


- 


b 


- 


b 


- 


80 


83 


82 


86 


72 


76 


84 


81 


79 


91 


82 


90 


76 


71 


75 


86 



Zal^ned independent of the present data sample. 



items on this Likert yP® .. sca ies. No alternative pro- 

Z Ste^c^ncy for this scale was 

fr e> t— r? ned. 



mi* 



-64- 

TABLE 31 



Correlations between absolute; 


•value scores 


and measures of achievement. 








1 


2 


Measure 






1 Intrinsic Interest 


55 


54 


2 Perceived Utility 


42 


42 


3 Aiken scale 


67 


39 


4 Dutton scale 


6o 


38 


5 Perceived Knowledge 


4l 


33 


6 Ease of Learning 


4 7 


29 


7 Expected Grades _ 


41 


28 


8 Actual Grades 


17 


l4 


9 STEP-Math 


07 


15 



obtained on attitude and interest indices 



3 


4 


5 


6 


7 

i 


8 


9 


TO 


67 


54 


59 


36 ; 


36 


22 


51 


49 


43 


43 


30 


28 


29 


69 


85 


68 


70 


48 : 


48 


34 


82 


65 


6l 


63 


44 


42 


32 


5T 


52 


59 


72 


5T 


63 


’ 45~ 


58 


51 


62 


57 


56_ 


58 


39 


J51 

28 


25 


63 

45 


56 

31 


45 

50 


68 

65 


39 

49 


23 


22 


38 


27 


38 


43 


6l 



TABLE 32 



Correlations between rank-position, 
and measures of achievement. 

Measure 


scores 

2 


1 / Intrinsic Interest 


47 


56 


2 rerce- ved Utility 


50 


39' 


3 Aiken scale 


47 


24 


4 Dutton scale 


45 


25 


5 Perceived Knowledge 


67 


38 


6 Ease of Learning 


47 


34 


7 Expected Grades 


52 


35 


8 Actual Grades 


12 


02 


9 STEP-Math 


08 


02 



obtained on attitude and interest indices 



3 


4 


5 


6 


7 


8 


9 


59 


5T 


69 


60 


53 


32 


19 


36 


36 


43 


35 


33 


10 


13 


69 


85 


56 


52 


47 


48 


34 


82* 


6ST 


56 


50 


44 


42 


32 


45 


43 


44 


78 


66 


43 


19 


44 


42 


67* 


45 


67 


39 


15 


44 

31 


41 

28 


67 

15 


63 

15 


37~ 

20* 


38 

65* 


17 

49_ 


23 


22 


13 


14 


15 


43 


6l 



•Fall (pre) scores shown below diagonal 
Soring (post) scores shown above diagonal 
Fall-spring correlations for sane scales shown on 



the diagonal 
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interest, perceived utility end general attitudes ai£ interest ^ tQ ^cceae- 

( 3 ) Pupil Judgments or perceptions of their own f ease -of-learn- 

fully achieve the goals illicit in the subject matter the 

ing, perceived knowledge and expected grades# In 
variables have been grouped according to these categor 

This grouping is supported by the fact that ^ ^^f^^^^^^tions between these 
and interest indices tend to be consistently Wgber t .. . . pupil grades 

indices and the separately obtained objective indices « l^cal 

and achievement test scores. For the STEP measures of the pupils mathe- 

grounds would seem to be the best index among these meas . j t is evident 

matics proficiency or ability, the lowest relations reflecting to any great 

Sat the attitude and interest indices on the *iole ^ciScTS fl^srccm perfor- 
ertent factors in common with the pupils me P ^ that the indices of 

mance in mathematics. That is, the relations obtained qualitles that 

pupil attitudes toward mathematics subject ia ability in mathematics. Also, 

Wie relatively independent of objective Ms rtiW had higher 

the variables reflecting the pupi lrf 8 “ b J ec * iv *. i ^!*^ ^ illt y than did the latter 
relations vith both subject natter interest and actu^ aMli^ yarlable8 appeared 

two sets of variables with each other. However, «»eeotually separate oual- 

sufficiently independent to he treated “representing concept^ ^ ^laticns 

ities or characteristics of the pupils. At , * ve^dier and the sub- 
obtained for the absolute-value scores ‘^rSith actual grades 

growings less clear. The correlations o intercorrelsticn 

Sdwith the BOX. index show the greatest increase as does the intercom 

between these two variables. + y, p -factors associated with 

This appears to suggest that over the year the factors ^ Qther 

pupil grades and learning difficulty cone to ^ ^ categories of variables 

variables. Whether the distinctions between ^ £*“£** empirically 

as well as between measures °^J ar ^ a ^; e ! “ i ^^L a pre Sction and differentiation 

useful and valid will be determined tjy the incre P ^ analyses to be 

such distinctions can provide which nature. That 

carried cut with this data concerning q cerceived ability or proficiency 

the distinction, for example ^ relations has 

in school subjects in general can Field dif indication is provided 

been shown in recent research *Jr ookover I ( U h Also °£* ? tieataeat effects 
by the results presented above which S ' ^ g “<^sm comparisons. These 

observed on the separate indices for the different E pro^ 0 71he measures in- 
results do not however provide to have provided functionally 

~ — ■*“ ‘ST. 

considered (Table 32 ) tended to he ^ ccmaaa factors than were 

This indicates that the r-p score ® ^ "f 1 ! ” r^c^e^htd lower correlations than 
the a-v scores. It also appears that the P ( a . c , Aiken and Dutton 

a-v scores with measures for th ^ the factor or fac cors partialed 

scales, grades and test scores) ^^^^ r-P scores) were contributing to 

higher ^ti^ LU 'mm of the "^^^1 iST5 S 

75X22^ wlables foP the 
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separate scores that were used and between the r-p and a-v scores. 

It might he noted that the pre-post correlations for each ot _ the ^®®™^® a 

lower for the r-p than the a-v scores which indicates that the r-p 
greater tendency 5 to change. Since r-p and a-v scores shoe about * ^e^v scores 
of internal consistency, the r-p scores exhibit somewhat mo . change e.g. 

the qualities Bereiter ( 3 ) has suggested as desireahle for assess g 
high internal consistency, low correlation over time. 

IV. Discussion 

The question of main concern for this study**; 
contributed to the development of differential pupil attit 
as compared to conventional programs of instruction. 

Considering the most general measures of interest ^ md ^^^ ^oward ut 
ics, as provided by the Aiken and Dutton scales, there geared t o be^i^ x 

of an overall differential effect for the E P rc ^? B ?* resu ited from a difference 
vas any difference observed for these assures and this ^suited from 

for girls having initiaUy lower interests. Among the latter, n the 

with the UICSM program did exhibit higher interests than 

same teachers with conventional programs. 

On the measure developed to assess specific attitude 

vhat more general and definite differences among the instructional P gr 
observed in the main analysis. 

Considering the moot direct indices of attitudes, for the 

to^develcp STSSS STlity 

STx anXThe^ -ceived pledge 

indices. 

At the sane time for the UICSM 

developaent of somewhat more pool Mj was clearly indicated on 

DroCTam clssses taught by the sses teac • 0 . , ffprenccs Tot 

the^erceived UtirX index for both a-v and r-p scores. Similar differences for 

girls -vtone uere found on the Intrinsic Interest index. 

In general considering the results from the ^^effectefthfdewl^nt 
indices there were some indications that P positive attitudes for 

of differential attitudes attitudes 

the pi^ils instructed jith Bail Sta ^ no w consistent d- ferences 

for those instructed with the UICS p ogr indications that pupils 

S^rnr^di^ces^^^ a 

snail proportion of overall score variance in each instance. 
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Subsequent analyse, were **» or 

zsjzzz j ^ xts . v 22 \ 5 £- 

SS^S^“-SS"”^ “ *” «“ un “““ “'■ 

ferences vas necessary* 

tort la. of several instructional pSpll 

the attitudinal outcomes revealed 3^ the Ball State and SMSG instructe 

ludmnents of their instructional “^^®; t , B 3 ergtanainR their texts much more^ 
pupils'* reported relatively greater ttfficul^ . ^ mcSM pupils, hovever, did not 

frequently than did v£h when, they were compared, 

differ in this respect from the c class pup 

M „ . 44 sMwi'Hr" was a factor affecting end- 

The results also indicated that textbook . . t bis factor contributed to 

jsassss r t — - — - — 

and the SMSG instructed pupils. 

Separate analyses costdered grading 

evaluations of the experimental program y ^di ca te that either of these 

<* ^ iis 111 ^ of the E or c groups 

being compared. 

, ^ + n. the e programs was also examined. 

The effect of the teacher’s learning index for fne SMSG teachers 

only difference observed was on the nunils was observed for teachers 

vhere greater learning difficulty a^ong^ *£*#*£„, This result is 
vfao had the greatest amount of ence supported by further evidence 

rsSi -« <*• — ■«- 

Caparisons vere also made to determine 

$S"tith certain relevant pupil ctaracterf**" erta ence that the E pro- 

ISheontics. Prom the analyses carried out . there vas higher 0 r lover 

any differential proficiency teat scores 

levels of proficiency in matheMtics using as 
obtained a* the beginning of the year. 

Although there appeared to he indications used, simi- 

varied hetveen sexes for certain attitu . . ecerences were assessed directly for 

lar indications ve^ot^htatoed^vhen 8 “^^ that there vas a sex difference re 

reV^s “le or other factors specific to the a-v scores. 

A-rfeets were observed for the pupils 

Overall the largest instruction! «lPW“ ( ‘"g^tional materials. Hovever.in 
l udgme nts concerning the difficulty , regard for pupils instructed vith 

itiS^f the rather large differences £ .^L’ for these pupils, al- 
the Ball State and S*G proffracs, the attitude ^ vere not of a similar 
though Clearly affected by the text ditiiculty i“d^ • ttitudea being measured 
^f$ude! Sis may reflect in part ** 9 ^££ y a £it^s to be sustained by a 

general, that is, the tendency for the reflect, hoveren the counter-: 
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For the Sl-SG program the resSti^^^t^difTiculty pupils had with 

istics countering the negative effects resul «8 rf appr0 ximately the same 

the materials. The text difficulty however, the SMSG pupils did not 

magnitude for the Ball State and S!«G programs , Attitudes that was observed for the 

show the same tendency to ^ eve }, 0 ^ cLroarisons were made adjusting for text difficulty 
Ball State pupils. Also when E-C corapar effects), there were some 

differences (i.e. partialling ou ® perception of their own knowledge SMSG pupils 
indications that with respect to their p pt . pupils* No similes 

■levelcr^J Bor. I**!*!** "it vm not nti '.tr.t, htnreter. “t** 

sss.*s rss — *• 

A m niiltv were not observed for UICSM 

may have contributed somewhat to these effects. 

Among the attitude indices the largest 

Utility - a measure of expected “^^JSions’teaicating that 

st^rraLttofjthe 

%$."t£S£ tX ““»t“4r4«t- -r ... •» «w » 

The difference in this respect for ^^^^r^re^h^i^f icance 

this characteristic of mathematics as a subject <* t algebra is elected because 

until the ninth grade at whioh tme. ng objectives. Consequently pupils 

Of its relevance for future ed “f ^e^n^ly established on the basis of 
reactions along this dimension w not be ^ firmly interest or perceived 

previous experience as are reactions reflecting inor 

knowledge . 

V. Summary 

• i {4-n^pq toward and interests in 

Questionnaire indices designed toassesspupil tXit d t0 pupils in 

mathematics were administered at beginning and end °f t^ hy the same 

asr a-si-ss sr?isrs-5i£ p— ^ state * ui<sm ’ or 

SWSG, the other with a conventional program. 

Comparisons were made “L^^were 0 ^ ^bt^inedU^LSef ^more 

sarssarssa 

specific mathematics at * itude dil “ ‘ tionnaire measures of other attitude relevant 
utility, and perceived ^ j udgmen ts of the instructional materials 

^SsrlSn^n ITSSarSi sr^s and proficiency test scores. 

The results indicated that in 

- this 8tuay * 
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Among the differences observed was a snail but con ^®* e ^^"^ n ^ t ^u d ea P ^d for 
instructed vith the Boll State program to develop less Ppsitt itive attitudes 

those instructed with the U1CSM program to develop some^at more 
than pupils in the respective comparison classes instructed with convention P 

P Also there was eone evidence that pupils instructed with ^ The 

programs had somewhat more learning difficulty in gener^tten C class pupils, 
latter difference was most clearcut for the Ball State pupils. 

Comparisons considering instructional factors and c^dmons ^lev-t t° attitude 

change revealed moderately large differences in textbook d^iculW J°r P“P 

instructed with Ball State and SMSG programs. \ 3 p n/i n 

tion indicated difficulty ^^“^^/^ted that this factor was 
the comparison C classes. Additional analysis SU B& 4 ^4.4.4+,,^^ than would 

probably contributing to the development and SMS g classes which 

otherwise have been the case for pupils in .. ttitude differences 

ar sry . _ 

tions of differences in the grades received by the E and t class pup 

Other analyses indicated ^^heirlSerience 

witb^he rp^^Tf^nttal^cted any of the instructional program (E -0 
differences . 

To determine the nature of these relations j« -«« 

^U^cSried'ouf orchis ‘and similar data gathered in a subsequent year. 
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